-- Logs begin at Thu 2022-03-31 17:11:33 UTC, end at Thu 2022-03-31 18:45:29 UTC. -- Mar 31 17:51:50.616481 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 31 17:51:50 2022] *** Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: nodename: dv-cinder-master-3-iscsi Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: machine: x86_64 Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: clock source: unix Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: pcre jit disabled Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: detected number of CPU cores: 4 Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: current working directory: / Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: detected binary path: /usr/bin/uwsgi-core Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: your processes number limit is 47680 Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: your memory page size is 4096 bytes Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: detected max file descriptor number: 2048 Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: lock engine: pthread robust mutexes Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: thunder lock: enabled Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 31 17:51:50.631168 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 31 17:51:50.680823 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: Python main interpreter initialized at 0x5604616519c0 Mar 31 17:51:50.680823 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: python threads support enabled Mar 31 17:51:50.680823 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: your server socket listen backlog is limited to 100 connections Mar 31 17:51:50.680823 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: your mercy for graceful operations on workers is 90 seconds Mar 31 17:51:50.681198 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: mapped 403077 bytes (393 KB) for 2 cores Mar 31 17:51:50.681274 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: *** Operational MODE: preforking *** Mar 31 17:51:50.681547 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: *** uWSGI is running in multiple interpreter mode *** Mar 31 17:51:50.681547 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: spawned uWSGI master process (pid: 79905) Mar 31 17:51:50.681766 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 31 17:51:50.683788 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: spawned uWSGI worker 1 (pid: 79917, cores: 1) Mar 31 17:51:50.683788 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: spawned uWSGI worker 2 (pid: 79918, cores: 1) Mar 31 17:51:50.683788 dv-cinder-master-3-iscsi devstack@keystone.service[79905]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 31 17:51:56.471693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 17:51:56.471693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: from cryptography.utils import int_from_bytes Mar 31 17:51:56.472457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 17:51:56.472457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: from cryptography.utils import int_from_bytes Mar 31 17:51:56.473709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 17:51:56.473709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: from cryptography.utils import int_from_bytes Mar 31 17:51:56.474173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 17:51:56.474173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: from cryptography.utils import int_from_bytes Mar 31 17:51:56.518038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 31 17:51:56.518228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 31 17:51:56.518422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] command line args: [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 31 17:51:56.518647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 31 17:51:56.518750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 31 17:51:56.518826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 31 17:51:56.518897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ================================================================================ {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 31 17:51:56.519022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] command line args: [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 31 17:51:56.519134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] admin_token = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.519288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 31 17:51:56.519376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] config_dir = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.519455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ================================================================================ {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 31 17:51:56.519559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.519709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] admin_token = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.519787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] config_source = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.519908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] debug = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.519987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] config_dir = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] config_source = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] debug = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.520936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] list_limit = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] log_config_append = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] list_limit = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.521945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] log_dir = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] log_config_append = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] log_file = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] log_dir = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] log_file = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.522948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.523950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.524962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.525050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.525204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.525326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.525442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.525698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.525809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.525959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] publish_errors = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.526177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.526302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.526425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] publish_errors = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.526540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.526683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.526791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.526903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.527016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.527131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.527332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.527457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.527572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] standard_threads = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.527697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.528311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.528467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] standard_threads = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.528670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.528958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] use_journal = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] use_json = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] use_stderr = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] use_journal = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.529897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] use_syslog = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.530012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] use_json = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.530132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.530247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] use_stderr = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.530369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.530485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] use_syslog = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.530626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.530745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 17:51:56.530870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.530992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.530992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.531217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.531217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.531446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.531446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.531667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.531782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.531901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.532969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.533989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.534973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.535905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.536973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537094 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.537908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.538939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539388 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.539974 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.540883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.541962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.542958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.543076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.543191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.543301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.543481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.544159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.544429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.544555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.544673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.544795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.544923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.545983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.546209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.546399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.546399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.546642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.546763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.546891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.547907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.548022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.548022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.548246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.548360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.548360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.548591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.548967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549340 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.549926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.550945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.551886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.552935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.553895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554140 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.554978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] auth.external = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.555923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] auth.password = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.556874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] auth.token = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] auth.external = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.557997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] auth.password = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] auth.token = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.558973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] credential.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.559098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.559228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.559347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.559463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.559580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.559734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.559858 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] credential.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.560897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561610 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.561967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.562943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.563892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.564974 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.565921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566787 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.566903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.567969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.568905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569611 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.569964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.570930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.571982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.572948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.573898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.574945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575864 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.575982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.576919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.577979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.578936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.579889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.580938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.581976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.582103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.582220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.582336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.582452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.582567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.582702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.582898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.583947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.584890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585484 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.585958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.586989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.587944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.588914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589032 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] role.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] role.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589504 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589619 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.589965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.590090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.590208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.590867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.590987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] role.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] role.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.591947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.592887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.593940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594541 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.594946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595875 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.595990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.596934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.597980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.598940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.599993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.600969 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601673 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.601914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.connection = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.602940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603760 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603760 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.603978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.604165 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.604284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.connection = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.604412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.604538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.604655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.604772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.604887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.605996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.606686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.606888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 17:51:56.607672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 31 17:51:56.634403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.634643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.635077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.635931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.636201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.636470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.643739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.645390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.673778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.673995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.674542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.674798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.728598 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.729115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.778785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.778951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.779038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.779115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.844710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.844931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.845854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.846014 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.870796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.871016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.871241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.871323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.871463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.871556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.871884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.871968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.872132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.872311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.872387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.872460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.872543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.872718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.883486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.883755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.896791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897243 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.897961 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.898086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.898177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.898316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 31 17:51:56.915496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.915703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 31 17:51:56.916012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.916110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.916223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 31 17:51:56.916306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 31 17:51:56.916486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.916568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.916737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.916827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 31 17:51:56.916984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.917066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.917231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.917312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.917484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.917737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.928228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.928498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.928759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.929002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.929098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.929275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.929540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.929823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.937405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.938002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.940634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.940908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.941184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.941265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.941459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.941543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.941736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.941818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.941990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.942080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.942254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.942337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.942520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.942602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.942809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.942904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.943077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.943158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.943337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.943419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.943603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.943866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.970250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.970838 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.971833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.972107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.972437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.972714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.977226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.977613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.977890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.977983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.978198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.978594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.985990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.986238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.986742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.987031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.990596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.990900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.991177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.991457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.991542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:56.991729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.991811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.992000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.992082 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.992265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.992349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.992528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.992609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.992832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.993114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:56.993388 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.011222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.011489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.011883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.012825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.016807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.017350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.020394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.020782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.020934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.021225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.025707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.026308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.029458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.030141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.033021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.033315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.033594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.033730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.033868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.034025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.034146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.034305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.034418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.034586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.034906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.035189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.055214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.055214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.055214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.055458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.055524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.055587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.055587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.055587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.063105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.063673 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.064755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.065021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.065332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.065603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.068123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.068408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.068692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.068786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.068968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.069057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.069246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.069329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.069546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.069818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.082467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.082756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.083041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.083123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.083316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.083399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.083648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.083928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.084203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.084567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.084869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.084949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.085190 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.085488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.102563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.103376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.105780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.107218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.110141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.110710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.113042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.114721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.115001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.115279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.123462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.125129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.128411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.128714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.214180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.216167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.216445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.217013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.224627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.226192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.228023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.228364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.229704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.229984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.230342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.230634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.238516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.238769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.239045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.241028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.241310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.241582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.247092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.247523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.247807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.248080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.248352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.248620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.248897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.249164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.249460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.249634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 31 17:51:57.249737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.249908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.249991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.250217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.250300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.250477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.250562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.250765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.250859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.251071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.251339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.251605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.251868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.252139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.252409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.252665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.252921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.253186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 31 17:51:57.288608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5604616519c0 pid: 79918 (default app) Mar 31 17:51:57.290919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5604616519c0 pid: 79917 (default app) Mar 31 17:51:57.292053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f80d-2b1c-4d6b-b27f-94f4d9dbe7c3 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:51:57.292345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f80d-2b1c-4d6b-b27f-94f4d9dbe7c3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:51:57.292621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f80d-2b1c-4d6b-b27f-94f4d9dbe7c3 None None] PATH_INFO: `/v3` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:51:57.297003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Thu Mar 31 17:51:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:06.467947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2dc3-224b-46dd-a8da-b059e008aa4d None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:06.468495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2dc3-224b-46dd-a8da-b059e008aa4d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:06.468588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2dc3-224b-46dd-a8da-b059e008aa4d None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:06.473631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:06.478913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:06.479301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:06.479456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:06.509480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG oslo_db.sqlalchemy.engines [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 17:52:06.690377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG passlib.handlers.bcrypt [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79918) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 31 17:52:06.690835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG passlib.handlers.bcrypt [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79918) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 31 17:52:06.746112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:06.747766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:06.866957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 31 17:52:06.973728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2dc3-224b-46dd-a8da-b059e008aa4d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:07.007632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG oslo_db.sqlalchemy.engines [None req-2bda2dc3-224b-46dd-a8da-b059e008aa4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 17:52:07.136146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2dc3-224b-46dd-a8da-b059e008aa4d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:07.141118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68845f9-862d-45fe-9c44-5d95dfa5a5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:07.141789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68845f9-862d-45fe-9c44-5d95dfa5a5da admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:07.142075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68845f9-862d-45fe-9c44-5d95dfa5a5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:07.142355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68845f9-862d-45fe-9c44-5d95dfa5a5da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:07.150407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68845f9-862d-45fe-9c44-5d95dfa5a5da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:07.200831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b68845f9-862d-45fe-9c44-5d95dfa5a5da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 31 17:52:07.201171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68845f9-862d-45fe-9c44-5d95dfa5a5da admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:07.210327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Thu Mar 31 17:52:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 17:52:07.217163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:07.231180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6992b-b773-4de8-a186-b58dacf68034 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:07.236018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467ee9-9bb4-4ed2-98fe-35e56a3ba5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:07.237129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467ee9-9bb4-4ed2-98fe-35e56a3ba5dd admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:07.237413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467ee9-9bb4-4ed2-98fe-35e56a3ba5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:07.237696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467ee9-9bb4-4ed2-98fe-35e56a3ba5dd admin admin] PATH_INFO: `/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:07.239215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07467ee9-9bb4-4ed2-98fe-35e56a3ba5dd admin admin] RBAC: Authorizing `identity:get_project(project_id=742ba5e3bf724a7681af774ed2a8d3b2)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:07.293769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07467ee9-9bb4-4ed2-98fe-35e56a3ba5dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 31 17:52:07.294247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07467ee9-9bb4-4ed2-98fe-35e56a3ba5dd admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:07.298877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Thu Mar 31 17:52:07 2022] GET /identity/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:09.576637 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b022b5-ae2d-4de0-9bab-123d11acaf26 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:09.577205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b022b5-ae2d-4de0-9bab-123d11acaf26 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:09.577205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b022b5-ae2d-4de0-9bab-123d11acaf26 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:09.581659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:09.587136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac3a72-1298-4b29-8df5-b324b38b4a21 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:09.587558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac3a72-1298-4b29-8df5-b324b38b4a21 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:09.587703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac3a72-1298-4b29-8df5-b324b38b4a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:09.606123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-10ac3a72-1298-4b29-8df5-b324b38b4a21 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:09.608421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-10ac3a72-1298-4b29-8df5-b324b38b4a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:09.616512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 31 17:52:09.638799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b022b5-ae2d-4de0-9bab-123d11acaf26 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:09.650641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b022b5-ae2d-4de0-9bab-123d11acaf26 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:09.654888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3523852-494f-476a-b10e-e4cc7983f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:09.655513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523852-494f-476a-b10e-e4cc7983f14e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:09.655793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523852-494f-476a-b10e-e4cc7983f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:09.656066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523852-494f-476a-b10e-e4cc7983f14e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:09.663504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3523852-494f-476a-b10e-e4cc7983f14e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:09.665256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3523852-494f-476a-b10e-e4cc7983f14e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:09.674316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Thu Mar 31 17:52:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 17:52:09.679567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac3a72-1298-4b29-8df5-b324b38b4a21 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:09.689122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac3a72-1298-4b29-8df5-b324b38b4a21 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:09.693480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0915ef-b4e5-4ef3-86c2-ff199ba1ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:09.694338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0915ef-b4e5-4ef3-86c2-ff199ba1ca41 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:09.694645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0915ef-b4e5-4ef3-86c2-ff199ba1ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:09.694925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0915ef-b4e5-4ef3-86c2-ff199ba1ca41 admin admin] PATH_INFO: `/v3/users/214bd24980334d9c9b15c0df533aa535` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:09.696319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0915ef-b4e5-4ef3-86c2-ff199ba1ca41 admin admin] RBAC: Authorizing `identity:get_user(user_id=214bd24980334d9c9b15c0df533aa535)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:09.698134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0915ef-b4e5-4ef3-86c2-ff199ba1ca41 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:09.699720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Thu Mar 31 17:52:09 2022] GET /identity/v3/users/214bd24980334d9c9b15c0df533aa535 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:12.045806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3ffc-c85e-4f9a-9177-0ff196e0800b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.046344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3ffc-c85e-4f9a-9177-0ff196e0800b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.046344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3ffc-c85e-4f9a-9177-0ff196e0800b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.048303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:12.053313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc9ca-71aa-427e-bf6a-b0cc419510ea None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.053767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e788-0307-471f-ad25-101fff844616 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.053857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc9ca-71aa-427e-bf6a-b0cc419510ea None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.053927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e788-0307-471f-ad25-101fff844616 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.053991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc9ca-71aa-427e-bf6a-b0cc419510ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.054055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e788-0307-471f-ad25-101fff844616 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.055991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:12.062124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.062414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.062721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.071066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-632cc9ca-71aa-427e-bf6a-b0cc419510ea None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:12.072242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-632cc9ca-71aa-427e-bf6a-b0cc419510ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:12.102145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG passlib.handlers.bcrypt [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79917) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 31 17:52:12.102562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG passlib.handlers.bcrypt [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79917) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 31 17:52:12.150090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:12.150850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:12.151727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:12.175904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc9ca-71aa-427e-bf6a-b0cc419510ea None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.250195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:12.272171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.272334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc9ca-71aa-427e-bf6a-b0cc419510ea None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.303988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.304708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.304987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.305331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.316819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:12.323693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:12.324920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:52:12.331412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.368687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938769bc-3cf0-4748-be71-9ca4ef00dc29 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.401206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.402105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.402388 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.402697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.424549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81d77-f8a9-4ad5-aacd-d498370871da None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.457362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.458019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.458297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.458568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.459335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:12.459635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:12.461005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:12.468668 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:12.470171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:12.473521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:12.479370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.563162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:52:12.568647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.572077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388003ce-048d-4a80-a0bb-319dcf3050c3 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.604811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.605671 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.605943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.606212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] PATH_INFO: `/v3/users/214bd24980334d9c9b15c0df533aa535` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.608089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] RBAC: Authorizing `identity:get_user(user_id=214bd24980334d9c9b15c0df533aa535)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:12.609531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:12.611408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/users/214bd24980334d9c9b15c0df533aa535 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:12.616737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.662875 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0f228-ede9-41e7-966c-11c455af19e9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.695009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.695799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.696087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.696359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.709109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800de4b-ea68-4ede-a5e3-878ef569b61a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.714626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:12.716230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:12.733477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:52:12.734694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:52:12.740603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.741879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.742703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.742988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.743263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.744447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:12.745874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:12.748261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:12.753861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:12.838856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8045cef-8511-44ff-b60f-b5073f287d41 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.846195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89788d22-13d1-4a7c-bf49-09a7c8314ba9 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:12.870783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd14b9-4642-496c-8c0c-46382f710e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.871444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd14b9-4642-496c-8c0c-46382f710e56 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.871723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd14b9-4642-496c-8c0c-46382f710e56 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.872001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd14b9-4642-496c-8c0c-46382f710e56 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.872782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd14b9-4642-496c-8c0c-46382f710e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:12.873082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd14b9-4642-496c-8c0c-46382f710e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:12.874453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd14b9-4642-496c-8c0c-46382f710e56 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:12.878348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011559c3-5039-48af-bd87-4e9b9078d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:12.879027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011559c3-5039-48af-bd87-4e9b9078d302 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:12.879310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011559c3-5039-48af-bd87-4e9b9078d302 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:12.879587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011559c3-5039-48af-bd87-4e9b9078d302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:12.880415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011559c3-5039-48af-bd87-4e9b9078d302 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.domain.id=default, user.id=214bd24980334d9c9b15c0df533aa535) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:12.880731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011559c3-5039-48af-bd87-4e9b9078d302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:12.882156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011559c3-5039-48af-bd87-4e9b9078d302 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:12.889372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/role_assignments?user.id=214bd24980334d9c9b15c0df533aa535&scope.domain.id=default&role.id=641f3a975368436eac3de51f3605c569 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:12.891694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:15.682219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0b2d7-aa9c-49d0-bc52-8bc724abea9d None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:15.682751 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0b2d7-aa9c-49d0-bc52-8bc724abea9d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:15.682824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0b2d7-aa9c-49d0-bc52-8bc724abea9d None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:15.685553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:15.690972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9874c4-373f-420d-a3bd-0832743fa02e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:15.691418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9874c4-373f-420d-a3bd-0832743fa02e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:15.691588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9874c4-373f-420d-a3bd-0832743fa02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:15.696403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06acb-595c-45ef-8c8f-ad826ca5e4ac None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:15.696691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06acb-595c-45ef-8c8f-ad826ca5e4ac None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:15.696968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06acb-595c-45ef-8c8f-ad826ca5e4ac None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:15.698951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 13/23] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:15.704663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033af0-33b5-4c27-ae20-309a750ac732 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:15.704953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033af0-33b5-4c27-ae20-309a750ac732 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:15.705234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033af0-33b5-4c27-ae20-309a750ac732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:15.714730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4e9874c4-373f-420d-a3bd-0832743fa02e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:15.716180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4e9874c4-373f-420d-a3bd-0832743fa02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:15.735896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-5c033af0-33b5-4c27-ae20-309a750ac732 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:15.737330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5c033af0-33b5-4c27-ae20-309a750ac732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:15.838064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 11/24] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:15.840752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1350-6fc4-43aa-97e3-2715f91f5bd7 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:15.842931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1350-6fc4-43aa-97e3-2715f91f5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:15.843995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1350-6fc4-43aa-97e3-2715f91f5bd7 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:15.846006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 12/25] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:15.855960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711e4f7-d691-4019-acfc-835db2cdcef3 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:15.856440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711e4f7-d691-4019-acfc-835db2cdcef3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:15.857562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711e4f7-d691-4019-acfc-835db2cdcef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:15.865444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 14/26] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:15.876335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033af0-33b5-4c27-ae20-309a750ac732 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:15.893718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6711e4f7-d691-4019-acfc-835db2cdcef3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:15.896426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6711e4f7-d691-4019-acfc-835db2cdcef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:16.011367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 13/27] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:16.012263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711e4f7-d691-4019-acfc-835db2cdcef3 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:16.077707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033af0-33b5-4c27-ae20-309a750ac732 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:16.121317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:16.122019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.123073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.123467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.124251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:16.125709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:16.143796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711e4f7-d691-4019-acfc-835db2cdcef3 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:16.179554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:16.180354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.180639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.180916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.192242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:16.193722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:16.211682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:52:16.213255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 14/28] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:16.214043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:16.316537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7a9e-f2cb-4de9-9404-6338c8b3c2c7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:16.350725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:16.351880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.352369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.352840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.388086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:16.403520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:16.405003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 15/29] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:16.405782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:16.406662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 15/30] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Mar 31 17:52:15 2022] POST /identity/v3/roles => generated 219 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 17:52:16.411657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:16.592949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca43b9-9ff5-42a2-a13a-8da468eb6772 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:16.596804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477d93-45f7-4e2e-81b7-983e16584fba None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:16.633745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0795ae-ddf5-4115-8061-d9006450955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:16.634814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0795ae-ddf5-4115-8061-d9006450955a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.635328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0795ae-ddf5-4115-8061-d9006450955a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.635444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e7599-adb4-45e0-b9b8-5669bb04d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:16.635957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0795ae-ddf5-4115-8061-d9006450955a None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.636066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e7599-adb4-45e0-b9b8-5669bb04d4cf None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.636323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e7599-adb4-45e0-b9b8-5669bb04d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.636609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e7599-adb4-45e0-b9b8-5669bb04d4cf None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.637386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0795ae-ddf5-4115-8061-d9006450955a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:16.637491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e7599-adb4-45e0-b9b8-5669bb04d4cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:16.637701 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e7599-adb4-45e0-b9b8-5669bb04d4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:16.638737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0795ae-ddf5-4115-8061-d9006450955a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:16.640486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0795ae-ddf5-4115-8061-d9006450955a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:16.644268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e7599-adb4-45e0-b9b8-5669bb04d4cf None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:16.664843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 16/31] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:16.666509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e1332-51fe-4738-9a57-9f88f934338e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.667026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e1332-51fe-4738-9a57-9f88f934338e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.667469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 16/32] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:16.667943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e1332-51fe-4738-9a57-9f88f934338e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.670381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:16.678439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ece0-1ca0-4bf1-8163-2552bd8c007f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.678766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ece0-1ca0-4bf1-8163-2552bd8c007f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.679037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ece0-1ca0-4bf1-8163-2552bd8c007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.681350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e1332-51fe-4738-9a57-9f88f934338e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:16.710509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e050ece0-1ca0-4bf1-8163-2552bd8c007f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:16.714629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e050ece0-1ca0-4bf1-8163-2552bd8c007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:16.823240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 17/34] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:16.824498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ece0-1ca0-4bf1-8163-2552bd8c007f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:16.851900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e1332-51fe-4738-9a57-9f88f934338e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:16.897494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d93e1-fb7a-4d84-a161-23e785302d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:16.898401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d93e1-fb7a-4d84-a161-23e785302d9a None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.898855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d93e1-fb7a-4d84-a161-23e785302d9a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.899299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d93e1-fb7a-4d84-a161-23e785302d9a None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.900414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d93e1-fb7a-4d84-a161-23e785302d9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:16.902071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d93e1-fb7a-4d84-a161-23e785302d9a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:16.953460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ece0-1ca0-4bf1-8163-2552bd8c007f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:16.992141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:16.993048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:16.993328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:16.993606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] PATH_INFO: `/v3/users/214bd24980334d9c9b15c0df533aa535` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:16.994960 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] RBAC: Authorizing `identity:get_user(user_id=214bd24980334d9c9b15c0df533aa535)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:17.002142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:17.002142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 18/35] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:16 2022] GET /identity/v3/users/214bd24980334d9c9b15c0df533aa535 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:17.002142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:17.104106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f7814-333b-49ba-8acb-132872f60235 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:17.126401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 18/36] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:52:16 2022] POST /identity/v3/projects => generated 301 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:17.127977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf787d-da29-4bb3-a947-42efa79bb5b4 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.128277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf787d-da29-4bb3-a947-42efa79bb5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.128606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf787d-da29-4bb3-a947-42efa79bb5b4 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.134596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 19/37] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:17.135576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf787d-da29-4bb3-a947-42efa79bb5b4 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:17.148834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdbab3-a7dc-4ebc-b0b3-ac71f9d7051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:17.149584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdbab3-a7dc-4ebc-b0b3-ac71f9d7051e None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.149873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdbab3-a7dc-4ebc-b0b3-ac71f9d7051e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.150212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdbab3-a7dc-4ebc-b0b3-ac71f9d7051e None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.151191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdbab3-a7dc-4ebc-b0b3-ac71f9d7051e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:17.152700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdbab3-a7dc-4ebc-b0b3-ac71f9d7051e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:17.227606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 19/38] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Mar 31 17:52:16 2022] POST /identity/v3/roles => generated 225 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:17.229003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ea9a1-dd04-43f4-af3a-4f97e76a1c03 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.229297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ea9a1-dd04-43f4-af3a-4f97e76a1c03 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.229581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ea9a1-dd04-43f4-af3a-4f97e76a1c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.277876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e84ea9a1-dd04-43f4-af3a-4f97e76a1c03 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:17.284230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e84ea9a1-dd04-43f4-af3a-4f97e76a1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:17.300902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf787d-da29-4bb3-a947-42efa79bb5b4 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:17.364106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fdfdd-26bd-409b-939f-2e38f252c3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:17.364728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fdfdd-26bd-409b-939f-2e38f252c3c1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.365016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fdfdd-26bd-409b-939f-2e38f252c3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.365299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fdfdd-26bd-409b-939f-2e38f252c3c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.367870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fdfdd-26bd-409b-939f-2e38f252c3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:17.369839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fdfdd-26bd-409b-939f-2e38f252c3c1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:17.371934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 20/39] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:17.374174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a54dd-de11-415a-a3a7-6f14183e2735 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.378984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a54dd-de11-415a-a3a7-6f14183e2735 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.379343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a54dd-de11-415a-a3a7-6f14183e2735 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.381375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 21/40] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:17.382752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a54dd-de11-415a-a3a7-6f14183e2735 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:17.402461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 20/41] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:17.404052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8298-8d31-4e78-a436-05ebfb186576 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.404356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8298-8d31-4e78-a436-05ebfb186576 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.404628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8298-8d31-4e78-a436-05ebfb186576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.423296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-464c8298-8d31-4e78-a436-05ebfb186576 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:17.424488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-464c8298-8d31-4e78-a436-05ebfb186576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:17.504272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 21/42] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:17.505215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c8298-8d31-4e78-a436-05ebfb186576 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:17.520499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a54dd-de11-415a-a3a7-6f14183e2735 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:17.553391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:17.554258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.554539 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.554916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] PATH_INFO: `/v3/domains/default/users/214bd24980334d9c9b15c0df533aa535/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.557251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=214bd24980334d9c9b15c0df533aa535, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:17.558725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:17.600305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c8298-8d31-4e78-a436-05ebfb186576 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:17.638840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:17.638840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.638840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.638840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.639214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:17.639214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:17.658805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 22/43] 10.222.0.58 () {58 vars in 1361 bytes} [Thu Mar 31 17:52:17 2022] PUT /identity/v3/domains/default/users/214bd24980334d9c9b15c0df533aa535/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:52:17.659678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:17.722833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Mar 31 17:52:17 2022] POST /identity/v3/roles => generated 223 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:17.773104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e655-4025-4cb4-bc16-e258248aeb7f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:17.812626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67042659-9f9c-4152-805f-4fdc73cc3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:17.813509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042659-9f9c-4152-805f-4fdc73cc3c1a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.813797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042659-9f9c-4152-805f-4fdc73cc3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.814076 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042659-9f9c-4152-805f-4fdc73cc3c1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.815401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042659-9f9c-4152-805f-4fdc73cc3c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:17.816916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042659-9f9c-4152-805f-4fdc73cc3c1a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:17.818919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 23/45] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:17.824629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:17.939384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14c9d-4b56-4842-847b-91e30769cf15 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:17.979005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143eafa-2bde-4897-8e32-869bcdcd060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:17.979676 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143eafa-2bde-4897-8e32-869bcdcd060c None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:17.979965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143eafa-2bde-4897-8e32-869bcdcd060c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:17.980248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143eafa-2bde-4897-8e32-869bcdcd060c None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:17.980980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143eafa-2bde-4897-8e32-869bcdcd060c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:17.982441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143eafa-2bde-4897-8e32-869bcdcd060c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:18.083555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:52:17 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:19.979966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece46f8-cf53-4316-8f3d-959aa9b0cb9e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:19.980551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece46f8-cf53-4316-8f3d-959aa9b0cb9e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:19.980551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece46f8-cf53-4316-8f3d-959aa9b0cb9e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:19.983092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 24/47] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:19.988631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079d44-8dee-4ffd-bad0-51aa1967334a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:19.989053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079d44-8dee-4ffd-bad0-51aa1967334a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:19.989199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079d44-8dee-4ffd-bad0-51aa1967334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.007183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-51079d44-8dee-4ffd-bad0-51aa1967334a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:20.008404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-51079d44-8dee-4ffd-bad0-51aa1967334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:20.077450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 24/48] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:20.100901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece46f8-cf53-4316-8f3d-959aa9b0cb9e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:20.197368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece46f8-cf53-4316-8f3d-959aa9b0cb9e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:20.232000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455b63c-33a7-4094-8fbd-0d7b5ce473db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:20.232713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455b63c-33a7-4094-8fbd-0d7b5ce473db None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.232994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455b63c-33a7-4094-8fbd-0d7b5ce473db None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.233270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455b63c-33a7-4094-8fbd-0d7b5ce473db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.243185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455b63c-33a7-4094-8fbd-0d7b5ce473db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:20.250079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-6455b63c-33a7-4094-8fbd-0d7b5ce473db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:20.251298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 25/49] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:20.257200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079d44-8dee-4ffd-bad0-51aa1967334a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:20.353561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079d44-8dee-4ffd-bad0-51aa1967334a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:20.362228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aba8a-e541-48d2-9b78-2428cb4f8d42 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.362524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aba8a-e541-48d2-9b78-2428cb4f8d42 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.362833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aba8a-e541-48d2-9b78-2428cb4f8d42 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.364617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 26/50] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:20.369363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988ce37-9564-48c4-b7a9-e070edacf800 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.369648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988ce37-9564-48c4-b7a9-e070edacf800 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.369925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988ce37-9564-48c4-b7a9-e070edacf800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.387270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b988ce37-9564-48c4-b7a9-e070edacf800 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:20.389319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b988ce37-9564-48c4-b7a9-e070edacf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:20.389441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:20.390045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.390325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.390602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.391381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:20.391686 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:20.393153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:20.401230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 25/51] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:20.407078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:20.454676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 27/52] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:20.477765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988ce37-9564-48c4-b7a9-e070edacf800 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:20.501657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60091627-d243-4149-80e0-aef1a74a8e2b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:20.533615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:20.534523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.534855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.535134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] PATH_INFO: `/v3/users/214bd24980334d9c9b15c0df533aa535` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.536460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] RBAC: Authorizing `identity:get_user(user_id=214bd24980334d9c9b15c0df533aa535)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:20.537902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:20.539545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:20 2022] GET /identity/v3/users/214bd24980334d9c9b15c0df533aa535 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:20.545383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:20.580531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988ce37-9564-48c4-b7a9-e070edacf800 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:20.614474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:20.615299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.615589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.615870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.617079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:20.618566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:20.620361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 28/54] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:20.625703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:20.640445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a107-774b-429f-a116-03b638e20f29 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:20.672907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:20.673691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.673974 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.674250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.675462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:20.676893 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:20.678687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:20.684116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:20.719477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000885d-7a34-44f2-a49e-b09b2d898ee6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:20.751581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e150ea0-77a5-49d6-85e9-51cd93a02f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:20.752299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e150ea0-77a5-49d6-85e9-51cd93a02f82 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.752529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e150ea0-77a5-49d6-85e9-51cd93a02f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.752807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e150ea0-77a5-49d6-85e9-51cd93a02f82 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.753521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e150ea0-77a5-49d6-85e9-51cd93a02f82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:20.754997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e150ea0-77a5-49d6-85e9-51cd93a02f82 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:20.777230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d40e6e-15d4-4fa9-a6de-5dc727c58df2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:20.810239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196cabb-f576-4c67-831a-7653442f844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:20.811440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196cabb-f576-4c67-831a-7653442f844b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:20.811802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196cabb-f576-4c67-831a-7653442f844b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:20.812605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196cabb-f576-4c67-831a-7653442f844b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:20.815575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196cabb-f576-4c67-831a-7653442f844b None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.domain.id=default, user.id=214bd24980334d9c9b15c0df533aa535) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:20.815575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196cabb-f576-4c67-831a-7653442f844b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:20.815575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196cabb-f576-4c67-831a-7653442f844b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:20.820267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 28/56] 10.222.0.58 () {56 vars in 1322 bytes} [Thu Mar 31 17:52:20 2022] GET /identity/v3/role_assignments?user.id=214bd24980334d9c9b15c0df533aa535&scope.domain.id=default&role.id=641f3a975368436eac3de51f3605c569 => generated 530 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:20.877694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 29/57] 10.222.0.58 () {60 vars in 1140 bytes} [Thu Mar 31 17:52:20 2022] POST /identity/v3/projects => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 17:52:23.198888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a0cc-8b03-4579-83b4-0396918d8568 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:23.199389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a0cc-8b03-4579-83b4-0396918d8568 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:23.199468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a0cc-8b03-4579-83b4-0396918d8568 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:23.202014 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 29/58] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:23.207140 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a5ae-4391-4c25-9427-1873d6dc972f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:23.207533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a5ae-4391-4c25-9427-1873d6dc972f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:23.207698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a5ae-4391-4c25-9427-1873d6dc972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:23.224634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a2d0a5ae-4391-4c25-9427-1873d6dc972f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:23.225810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a2d0a5ae-4391-4c25-9427-1873d6dc972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:23.287770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 30/59] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:23.311644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7a0cc-8b03-4579-83b4-0396918d8568 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:23.409867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7a0cc-8b03-4579-83b4-0396918d8568 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:23.441538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7235a4-7915-47f7-8371-d96fb63c511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:23.442321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7235a4-7915-47f7-8371-d96fb63c511d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:23.442603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7235a4-7915-47f7-8371-d96fb63c511d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:23.442909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7235a4-7915-47f7-8371-d96fb63c511d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:23.444081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7235a4-7915-47f7-8371-d96fb63c511d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:23.445505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7235a4-7915-47f7-8371-d96fb63c511d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:23.451164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 30/60] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:23.453425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a5ae-4391-4c25-9427-1873d6dc972f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:23.547284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a5ae-4391-4c25-9427-1873d6dc972f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:23.579846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035975a-d16c-482c-b004-6a56bc806995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:23.580455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035975a-d16c-482c-b004-6a56bc806995 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:23.580741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035975a-d16c-482c-b004-6a56bc806995 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:23.581020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035975a-d16c-482c-b004-6a56bc806995 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:23.581742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035975a-d16c-482c-b004-6a56bc806995 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:23.583219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035975a-d16c-482c-b004-6a56bc806995 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:23.696510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 31/61] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:52:23 2022] POST /identity/v3/users => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:27.300477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7d15c-0a5c-45f6-a61e-dda50be83e1a None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.301479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7d15c-0a5c-45f6-a61e-dda50be83e1a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.302012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7d15c-0a5c-45f6-a61e-dda50be83e1a None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.304045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 31/62] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:27.305137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da2432-4ce2-4f50-b096-0874ac198f15 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.305539 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da2432-4ce2-4f50-b096-0874ac198f15 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.305707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da2432-4ce2-4f50-b096-0874ac198f15 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.307753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:27.313988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa9d6-d8b7-40de-8221-7c13afa0e358 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.314139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93058-d4bb-404e-869b-29f85cd42817 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.314449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93058-d4bb-404e-869b-29f85cd42817 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.314779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93058-d4bb-404e-869b-29f85cd42817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.315089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa9d6-d8b7-40de-8221-7c13afa0e358 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.315596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa9d6-d8b7-40de-8221-7c13afa0e358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.332386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-65e93058-d4bb-404e-869b-29f85cd42817 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:27.333705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1baaa9d6-d8b7-40de-8221-7c13afa0e358 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:27.333975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-65e93058-d4bb-404e-869b-29f85cd42817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:27.334909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1baaa9d6-d8b7-40de-8221-7c13afa0e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:27.402507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 33/64] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:27.404807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef224e-7588-4bbd-8873-bb19c14ba528 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.405391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef224e-7588-4bbd-8873-bb19c14ba528 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.405502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 32/65] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:27.405907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef224e-7588-4bbd-8873-bb19c14ba528 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.407797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 34/66] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:27.415589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75449600-86a8-4a60-a31c-15186c870681 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.417062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75449600-86a8-4a60-a31c-15186c870681 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.417488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75449600-86a8-4a60-a31c-15186c870681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.432222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef224e-7588-4bbd-8873-bb19c14ba528 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:27.443563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-75449600-86a8-4a60-a31c-15186c870681 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:27.445485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-75449600-86a8-4a60-a31c-15186c870681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:27.534637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 33/67] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:27.534637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75449600-86a8-4a60-a31c-15186c870681 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:27.571465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef224e-7588-4bbd-8873-bb19c14ba528 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:27.607562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:27.608378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.608666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.608941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.619617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:27.626865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:27.632946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 35/68] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:52:27.632946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:27.665270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75449600-86a8-4a60-a31c-15186c870681 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:27.703694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68120116-0c0d-4c70-878f-8770fa90faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:27.704756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68120116-0c0d-4c70-878f-8770fa90faec None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.705190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68120116-0c0d-4c70-878f-8770fa90faec None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.705614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68120116-0c0d-4c70-878f-8770fa90faec None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.715376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68120116-0c0d-4c70-878f-8770fa90faec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:27.723037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-68120116-0c0d-4c70-878f-8770fa90faec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:27.724398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:27.725795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18428eda-7236-41c2-8898-27b3d6753bd3 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.726134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a69e7-c768-493c-acd3-375522a4b280 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:27.726360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18428eda-7236-41c2-8898-27b3d6753bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.726786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18428eda-7236-41c2-8898-27b3d6753bd3 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.728584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 35/70] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:27.733857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18428eda-7236-41c2-8898-27b3d6753bd3 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:27.760694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:27.761507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.761794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.762070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.773367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:27.780663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:52:27.786681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:52:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:27.786681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:27.837961 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18428eda-7236-41c2-8898-27b3d6753bd3 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:27.870000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6dce-0c9e-41ee-bee6-2fa468063819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:27.870688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6dce-0c9e-41ee-bee6-2fa468063819 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.870976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6dce-0c9e-41ee-bee6-2fa468063819 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.871255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6dce-0c9e-41ee-bee6-2fa468063819 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.872003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f6dce-0c9e-41ee-bee6-2fa468063819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:27.872312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f6dce-0c9e-41ee-bee6-2fa468063819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:27.876568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f6dce-0c9e-41ee-bee6-2fa468063819 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:27.878122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6987678-018b-4a0b-ab77-9a479fcc6424 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:27.884370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 36/72] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:27.885567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c2bb-afd5-40a8-8e94-efce4fa085fa None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.885857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c2bb-afd5-40a8-8e94-efce4fa085fa None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.886138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c2bb-afd5-40a8-8e94-efce4fa085fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.901924 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b031c2bb-afd5-40a8-8e94-efce4fa085fa None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:27.903139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b031c2bb-afd5-40a8-8e94-efce4fa085fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:27.914529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:27.915219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.915503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.915786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.916538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:27.916851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:27.918236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:27.930247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:27.931055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:27.972490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 37/74] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:27.980719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20950ee3-30df-4b01-9da8-f0bdfa6f4b89 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:27.980719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20950ee3-30df-4b01-9da8-f0bdfa6f4b89 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:27.980719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20950ee3-30df-4b01-9da8-f0bdfa6f4b89 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:27.980719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 38/75] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:27.980719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20950ee3-30df-4b01-9da8-f0bdfa6f4b89 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.027920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd4b51-33fa-4386-b3aa-5e02ff9366f2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.062600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.063303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.063590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.063866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.064636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:28.064929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.066313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.074237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 38/76] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:28.079434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.079542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20950ee3-30df-4b01-9da8-f0bdfa6f4b89 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.110552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e58b9-f5d4-481f-8b70-c757af1ffb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.111630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e58b9-f5d4-481f-8b70-c757af1ffb11 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.111906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e58b9-f5d4-481f-8b70-c757af1ffb11 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.112176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e58b9-f5d4-481f-8b70-c757af1ffb11 None admin] PATH_INFO: `/v3/users/214bd24980334d9c9b15c0df533aa535` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.113346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e58b9-f5d4-481f-8b70-c757af1ffb11 None admin] RBAC: Authorizing `identity:get_user(user_id=214bd24980334d9c9b15c0df533aa535)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.114802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e58b9-f5d4-481f-8b70-c757af1ffb11 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.116592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 39/77] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:27 2022] GET /identity/v3/users/214bd24980334d9c9b15c0df533aa535 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:28.117514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb009d6-cd0b-491b-a773-447d723abee3 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.117794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb009d6-cd0b-491b-a773-447d723abee3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.118078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb009d6-cd0b-491b-a773-447d723abee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.135587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0bb009d6-cd0b-491b-a773-447d723abee3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:28.136743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0bb009d6-cd0b-491b-a773-447d723abee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:28.170440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6ace3-abcb-4c66-8e75-6cb705973e1a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.199891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 40/78] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:28.200748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb009d6-cd0b-491b-a773-447d723abee3 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.202700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.203580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.203902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.204149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.219098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.220641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.222469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 39/79] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:28.223228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.295334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb009d6-cd0b-491b-a773-447d723abee3 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.318436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee1ea-fdb5-4dfa-9fb9-837e7041c5f9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.328777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.329568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.329847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.330127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.339768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:28.346704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:28.347866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 41/80] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:28.350810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.354306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.355315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.355703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.356040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.357807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.359343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.361244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 40/81] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:28.362123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.444083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740681-76c1-41b1-b7e9-a780d9c92803 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.457616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8c02-fa66-4db9-9e32-402e7f00a8d6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.477142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.477794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.478079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.478363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.491502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.492157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.492447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.492731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.542084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.543599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.557268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.558743 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.635794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 42/82] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:28.639682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.657645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 41/83] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:28.657645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.733362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b4ae3-25c2-4b33-9e83-996877decdbd None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.748566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd15cc-5472-4333-9de9-b93053f57491 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.766549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.767374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.767655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.767939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.769098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.770548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.772165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 43/84] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:28.776788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.781933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.782666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.782957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.783235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.783991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:28.784301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.785740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.793756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 42/85] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:28.795136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.870710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cc459-b4ae-4ff6-99be-62dd29d4d6e1 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.891821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94940b3-bf6b-41df-b1e2-20cb0bc892c2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:28.903412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.904597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.904882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.905163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.924759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:28.925622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:28.925907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:28.926182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:28.927420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.928830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:28.930499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 43/86] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:28.931296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:28.968938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:28.970410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.023783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c82b8-9a11-44a9-88ce-f395b90c909a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.058280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.058889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.059174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.059451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.061312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.062806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.064495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 44/87] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:29.065224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.068856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 44/88] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:29.069923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.163302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67f292-61ae-4a7d-b2c2-3d961e1ddad5 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.163718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0713-a522-4b35-b0d7-152dff1703e7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.194293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.194987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.195271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.195360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.195549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.196172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.196258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.196455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.196733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.197685 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.197945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.199427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.201568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 45/89] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:29 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:29.202476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.282190 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 45/90] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:52:29 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:29.283061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.302126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291921-da6e-4fd7-a0b1-75fdd3a5074f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.338684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.339350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.339640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.339909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.340767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=214bd24980334d9c9b15c0df533aa535) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:29.341079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.343021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.349131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 46/91] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:29 2022] GET /identity/v3/role_assignments?user.id=214bd24980334d9c9b15c0df533aa535&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:29.350006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.398512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5f7c-643c-4f8f-b244-0e683d0715c5 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.440704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.441753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.442271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.442789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.443899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=87e005b975a34a64a110e48a187b85dd) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:29.444440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.446491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.457042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 46/92] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:29 2022] GET /identity/v3/role_assignments?user.id=87e005b975a34a64a110e48a187b85dd&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:29.458258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.470503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4333939-8f20-408a-a2da-b13e09c4be7e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.513928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.515267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.515568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.515848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.517486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.519563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.521614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 47/93] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:29 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:29.530918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.596158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61aa1-fb87-4337-897e-b184555a27fe None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.639945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.640628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.640920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.641204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.672964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c02062-b2a5-473f-aab5-88ac75eaef76 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:29.715562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:29.716138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:29.716947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:29.717336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:29.718178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] RBAC: Adding query filter params (role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=87e005b975a34a64a110e48a187b85dd) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:29.718488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.720002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.726515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 48/94] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:29 2022] GET /identity/v3/role_assignments?user.id=87e005b975a34a64a110e48a187b85dd&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:29.737041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:29.738571 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:29.865270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 47/95] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:29.870657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:29.981013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8674-65ed-4a32-9099-e15fe7eb231c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:30.016406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9f36-07d8-444f-aab5-888bead1a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:30.017275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9f36-07d8-444f-aab5-888bead1a86a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:30.017605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9f36-07d8-444f-aab5-888bead1a86a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:30.017877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9f36-07d8-444f-aab5-888bead1a86a None admin] PATH_INFO: `/v3/projects/9afcd906ab5e49519e631e62901bdf53` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:30.019154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9f36-07d8-444f-aab5-888bead1a86a None admin] RBAC: Authorizing `identity:get_project(project_id=9afcd906ab5e49519e631e62901bdf53)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:30.020717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9f36-07d8-444f-aab5-888bead1a86a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:30.026641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 49/96] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:29 2022] GET /identity/v3/projects/9afcd906ab5e49519e631e62901bdf53 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:30.030519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:30.183922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6951e-ff98-44d3-979e-ba1a7e036649 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:30.231308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7b0c0-94f8-445c-be96-17091511e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:30.231908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b0c0-94f8-445c-be96-17091511e24e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:30.232730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b0c0-94f8-445c-be96-17091511e24e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:30.233014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b0c0-94f8-445c-be96-17091511e24e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:30.234042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b0c0-94f8-445c-be96-17091511e24e None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=9afcd906ab5e49519e631e62901bdf53, user.id=87e005b975a34a64a110e48a187b85dd) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:30.234358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b0c0-94f8-445c-be96-17091511e24e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:30.235827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b0c0-94f8-445c-be96-17091511e24e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:30.245116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 48/97] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:30 2022] GET /identity/v3/role_assignments?user.id=87e005b975a34a64a110e48a187b85dd&scope.project.id=9afcd906ab5e49519e631e62901bdf53&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:32.326736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a1209-e00d-41e4-8a9a-9fb6fd2bb040 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:32.326736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a1209-e00d-41e4-8a9a-9fb6fd2bb040 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:32.326736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a1209-e00d-41e4-8a9a-9fb6fd2bb040 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:32.329481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 50/98] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:32.340299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac981f-705e-4265-9472-ff2b3b8c2ef2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:32.341211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac981f-705e-4265-9472-ff2b3b8c2ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:32.341802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac981f-705e-4265-9472-ff2b3b8c2ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:32.359898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b8ac981f-705e-4265-9472-ff2b3b8c2ef2 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:32.361691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b8ac981f-705e-4265-9472-ff2b3b8c2ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:32.454002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 49/99] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:32.489244 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a1209-e00d-41e4-8a9a-9fb6fd2bb040 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:32.617891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a1209-e00d-41e4-8a9a-9fb6fd2bb040 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:32.661758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b1c46-67cb-4258-87c3-fcf60405ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:32.662954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1c46-67cb-4258-87c3-fcf60405ff0b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:32.663452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1c46-67cb-4258-87c3-fcf60405ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:32.663926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1c46-67cb-4258-87c3-fcf60405ff0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:32.679727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b1c46-67cb-4258-87c3-fcf60405ff0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:32.687517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c48b1c46-67cb-4258-87c3-fcf60405ff0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:32.689036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 51/100] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:32.695062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac981f-705e-4265-9472-ff2b3b8c2ef2 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:32.842674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60255358-0108-4e7f-99ad-56b7e08d86c8 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:32.843381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60255358-0108-4e7f-99ad-56b7e08d86c8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:32.843880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60255358-0108-4e7f-99ad-56b7e08d86c8 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:32.846404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 52/101] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:32.854426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe8e3-2815-47da-8dc4-f96998743dad None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:32.855280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe8e3-2815-47da-8dc4-f96998743dad None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:32.855754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe8e3-2815-47da-8dc4-f96998743dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:32.866434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac981f-705e-4265-9472-ff2b3b8c2ef2 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:32.895821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2edbe8e3-2815-47da-8dc4-f96998743dad None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:32.896976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2edbe8e3-2815-47da-8dc4-f96998743dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:32.911235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:32.911939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:32.912227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:32.912504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:32.913275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:32.913590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:32.915007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:32.928953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 50/102] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:32.934429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.068162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 53/103] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:33.083772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996a1f8-bf9b-4667-add2-f8d02fafc63c None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.084294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996a1f8-bf9b-4667-add2-f8d02fafc63c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.084725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996a1f8-bf9b-4667-add2-f8d02fafc63c None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.086675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 54/104] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:33.091761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0beab-f03f-4f25-95ae-66c663d85eca None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.092250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0beab-f03f-4f25-95ae-66c663d85eca None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.092725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0beab-f03f-4f25-95ae-66c663d85eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.105462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dcf1b-b1db-40f8-b8b1-21df0dc4b11a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:33.140007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f0e0beab-f03f-4f25-95ae-66c663d85eca None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:33.140659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:33.141347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f0e0beab-f03f-4f25-95ae-66c663d85eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:33.141863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.142296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.142750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] PATH_INFO: `/v3/users/214bd24980334d9c9b15c0df533aa535` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.144131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] RBAC: Authorizing `identity:get_user(user_id=214bd24980334d9c9b15c0df533aa535)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:33.145727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:33.147879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 51/105] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:32 2022] GET /identity/v3/users/214bd24980334d9c9b15c0df533aa535 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:33.148816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.256246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 55/106] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:33.257346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0beab-f03f-4f25-95ae-66c663d85eca None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.317874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1821c-c05f-41ad-b9b4-3f987e48c679 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:33.359732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:33.361517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.361994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.362446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.363843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:33.365536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:33.367410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 52/107] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:33.372712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.380202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0beab-f03f-4f25-95ae-66c663d85eca None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:33.416316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c203f0-0068-44a7-965b-74ecdd6325d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:33.417199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c203f0-0068-44a7-965b-74ecdd6325d5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.417581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c203f0-0068-44a7-965b-74ecdd6325d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.417937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c203f0-0068-44a7-965b-74ecdd6325d5 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.419235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c203f0-0068-44a7-965b-74ecdd6325d5 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:33.421519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c203f0-0068-44a7-965b-74ecdd6325d5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:33.423646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 56/108] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:33 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:33.425017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd13d3-c23e-4e1b-a049-429962ec317b None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.425382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd13d3-c23e-4e1b-a049-429962ec317b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.425755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd13d3-c23e-4e1b-a049-429962ec317b None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.427502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 57/109] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:33.431970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd13d3-c23e-4e1b-a049-429962ec317b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.482535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b83c-f5dc-49d8-99a1-7e21230f8387 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:33.517755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:33.518956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.519450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.519944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.529926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:33.532764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd13d3-c23e-4e1b-a049-429962ec317b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:33.537053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:33.543027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 53/110] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:33.543027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.568567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873e16f-489d-4671-86d2-590fa5d8d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:33.569342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e16f-489d-4671-86d2-590fa5d8d05f None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.569625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e16f-489d-4671-86d2-590fa5d8d05f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.569899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e16f-489d-4671-86d2-590fa5d8d05f None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.570667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873e16f-489d-4671-86d2-590fa5d8d05f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:33.572110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873e16f-489d-4671-86d2-590fa5d8d05f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:33.643376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e009ec5-a7a5-448b-bd1d-5fd39441c657 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:33.657296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 58/111] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:52:33 2022] POST /identity/v3/projects => generated 302 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:33.657296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948d574-90ed-47e6-86f7-6e9bbbc8a44f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.657296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948d574-90ed-47e6-86f7-6e9bbbc8a44f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.657296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948d574-90ed-47e6-86f7-6e9bbbc8a44f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.657296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 59/112] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:33.657296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c9bf-ce68-4653-b970-f10643f96d18 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.657296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c9bf-ce68-4653-b970-f10643f96d18 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.658380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c9bf-ce68-4653-b970-f10643f96d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.684639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c7a1c9bf-ce68-4653-b970-f10643f96d18 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:33.687080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c7a1c9bf-ce68-4653-b970-f10643f96d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:33.693673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7613-11f9-4560-a135-0e17932c2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:33.694603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7613-11f9-4560-a135-0e17932c2f75 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.694977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7613-11f9-4560-a135-0e17932c2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.695265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7613-11f9-4560-a135-0e17932c2f75 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069/users/214bd24980334d9c9b15c0df533aa535/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.697429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e7613-11f9-4560-a135-0e17932c2f75 None admin] RBAC: Authorizing `identity:create_grant(project_id=16004a326feb4230b6b46f54063e1069, user_id=214bd24980334d9c9b15c0df533aa535, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:33.699099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e7613-11f9-4560-a135-0e17932c2f75 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:33.767759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 60/113] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:33.768640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1c9bf-ce68-4653-b970-f10643f96d18 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.793677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 54/114] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:33 2022] PUT /identity/v3/projects/16004a326feb4230b6b46f54063e1069/users/214bd24980334d9c9b15c0df533aa535/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:52:33.795354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a0b56-8493-4be1-a3e7-15886002a039 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.795650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a0b56-8493-4be1-a3e7-15886002a039 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.795930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a0b56-8493-4be1-a3e7-15886002a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.847871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e42a0b56-8493-4be1-a3e7-15886002a039 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:33.849061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e42a0b56-8493-4be1-a3e7-15886002a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:33.890180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1c9bf-ce68-4653-b970-f10643f96d18 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:33.921906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 55/115] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:33.922836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a0b56-8493-4be1-a3e7-15886002a039 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:33.936449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:33.938476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:33.939279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:33.940803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:33.941871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:33.943899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:33.946200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:33.961287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 61/116] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:33.962573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.056814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a0b56-8493-4be1-a3e7-15886002a039 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.072571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d73d4-3017-4e55-890a-22f71df16042 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.095033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.095862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.096154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.096434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.107454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:34.108193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3dd51-b6e4-40cd-9ee9-915e7942d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.109085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3dd51-b6e4-40cd-9ee9-915e7942d5db None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.109368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3dd51-b6e4-40cd-9ee9-915e7942d5db None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.109641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3dd51-b6e4-40cd-9ee9-915e7942d5db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.115502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:52:34.116945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 56/117] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:52:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:34.117729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.125224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3dd51-b6e4-40cd-9ee9-915e7942d5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:34.132364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-28b3dd51-b6e4-40cd-9ee9-915e7942d5db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:52:34.133886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 62/118] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:34.135199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91684fe-04f3-48de-a995-9531e6271d52 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.135491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91684fe-04f3-48de-a995-9531e6271d52 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.135775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91684fe-04f3-48de-a995-9531e6271d52 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.137704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 63/119] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:34.138451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91684fe-04f3-48de-a995-9531e6271d52 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.239104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79c092-60f7-437f-864f-68488a3bb384 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.264743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91684fe-04f3-48de-a995-9531e6271d52 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.279602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.280793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.281077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.281356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.283003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.285460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.287742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 57/120] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:34.288548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.306987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702409b-3947-4017-a5fc-1ff0d8096161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.308015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702409b-3947-4017-a5fc-1ff0d8096161 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.308491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702409b-3947-4017-a5fc-1ff0d8096161 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.308974 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702409b-3947-4017-a5fc-1ff0d8096161 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.309923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702409b-3947-4017-a5fc-1ff0d8096161 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:34.311042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702409b-3947-4017-a5fc-1ff0d8096161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.312616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702409b-3947-4017-a5fc-1ff0d8096161 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.321214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 64/121] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:34.322817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a7786-d498-4e06-a95c-d63b9f7ffbef None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.323304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a7786-d498-4e06-a95c-d63b9f7ffbef None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.323792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a7786-d498-4e06-a95c-d63b9f7ffbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.341068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-158a7786-d498-4e06-a95c-d63b9f7ffbef None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:34.343105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-158a7786-d498-4e06-a95c-d63b9f7ffbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:34.393663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95f9ac-8bcb-4120-a4db-527eda657909 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.412824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 65/122] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:34.414309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a7786-d498-4e06-a95c-d63b9f7ffbef None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.442158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.442853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.443143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.443425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.444244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:34.444558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.445944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.467745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 58/123] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:34.467745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.523022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a7786-d498-4e06-a95c-d63b9f7ffbef None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.558394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.559616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.560093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.560704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.562146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.563853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.566117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 66/124] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:34.566931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029216-12fc-4e7e-88d4-164b6c75cee1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.567424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.602702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.603420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.603758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.604039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.605308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.606899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.609397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 59/125] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:34.610145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.670939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139b56-fb2b-477f-853f-3f1643f68f67 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.705693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.706893 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.707372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.707871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.712464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb158a4-609d-4ae8-b6aa-437dc391130a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.718844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:34.726176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:34.727655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 67/126] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:34.728721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.753708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.754672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.754964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.755289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] PATH_INFO: `/v3/users/f84dec4fa2c94078a58e79f5a4e6b4e2` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.774096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=f84dec4fa2c94078a58e79f5a4e6b4e2)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.775786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.782414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 60/127] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/users/f84dec4fa2c94078a58e79f5a4e6b4e2 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:34.782414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.839280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da46d0-9176-4e59-b0ad-5f1ae7f58ce6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.873493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.874828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.875343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.875829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069/users/87e005b975a34a64a110e48a187b85dd/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.878023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=16004a326feb4230b6b46f54063e1069, user_id=87e005b975a34a64a110e48a187b85dd, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.879359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ff26-dcb3-4ff8-b117-f6f76f3bd8b4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:34.879935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.913325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:34.914204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:34.914486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:34.914793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:34.915983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:34.917421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:34.919350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 61/128] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:34.920143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:34.997362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 68/129] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:34 2022] PUT /identity/v3/projects/16004a326feb4230b6b46f54063e1069/users/87e005b975a34a64a110e48a187b85dd/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:52:34.999664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:35.063816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74851954-95a8-4ca6-a91e-7a8151cfc59c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.105301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:35.106361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:35.106878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:35.108359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:35.109407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:35.109920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:35.111934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:35.121681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 62/130] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:35.123034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:35.232088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef9ba-dfbd-4059-905a-61c24fb54e49 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.251695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4476f8-3189-406c-8691-c377c796caa6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.271270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:35.272168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:35.272456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:35.272730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069/users/87e005b975a34a64a110e48a187b85dd/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:35.276425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] RBAC: Authorizing `identity:create_grant(project_id=16004a326feb4230b6b46f54063e1069, user_id=87e005b975a34a64a110e48a187b85dd, role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:35.278084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:35.299634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:35.301919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:35.301919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:35.301919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:35.365283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 63/131] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:35 2022] PUT /identity/v3/projects/16004a326feb4230b6b46f54063e1069/users/87e005b975a34a64a110e48a187b85dd/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:52:35.366039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:35.402565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:35.404094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:35.509966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3cee-ea94-4e2c-9c95-b1680cf47277 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.550645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:35.551703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:35.552213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:35.552614 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:35.553872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:35.555982 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:35.557858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 64/132] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:35 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:35.564224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:35.603027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 69/133] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:35.609602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:35.680463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fb33d-3f41-4df2-ac60-2958aca1953e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.720670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:35.721682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:35.721976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:35.722264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] PATH_INFO: `/v3/projects/9afcd906ab5e49519e631e62901bdf53` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:35.723534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] RBAC: Authorizing `identity:get_project(project_id=9afcd906ab5e49519e631e62901bdf53)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:35.725433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:35.727178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 65/134] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:35 2022] GET /identity/v3/projects/9afcd906ab5e49519e631e62901bdf53 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:35.732770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:35.782785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84fee-ec0c-4127-bef2-88b7ebe228cf None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.819132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:35.820358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:35.820851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:35.821321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:35.822787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:35.824444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:35.827148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 70/135] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:35 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:35.835867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:35.849252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dde2bd-0ddd-49ca-a2bf-372f28641a9e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.883553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888cec5-f009-4938-b492-2e2ac51184e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:35.884703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cec5-f009-4938-b492-2e2ac51184e9 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:35.884993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cec5-f009-4938-b492-2e2ac51184e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:35.885278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cec5-f009-4938-b492-2e2ac51184e9 None admin] PATH_INFO: `/v3/projects/9afcd906ab5e49519e631e62901bdf53/users/87e005b975a34a64a110e48a187b85dd/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:35.887308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888cec5-f009-4938-b492-2e2ac51184e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9afcd906ab5e49519e631e62901bdf53, user_id=87e005b975a34a64a110e48a187b85dd, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:35.889436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888cec5-f009-4938-b492-2e2ac51184e9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:35.966765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c83df-e8c9-4b58-8243-b0c4eca9b507 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:35.978923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 66/136] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:35 2022] PUT /identity/v3/projects/9afcd906ab5e49519e631e62901bdf53/users/87e005b975a34a64a110e48a187b85dd/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:52:36.010509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb028034-fa1e-438f-afe3-48fe81c5da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:36.011274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb028034-fa1e-438f-afe3-48fe81c5da6a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:36.011562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb028034-fa1e-438f-afe3-48fe81c5da6a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:36.011840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb028034-fa1e-438f-afe3-48fe81c5da6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:36.012701 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb028034-fa1e-438f-afe3-48fe81c5da6a None admin] RBAC: Adding query filter params (role.id=0e2c092f713b413abc3ac9e75947878c, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=f84dec4fa2c94078a58e79f5a4e6b4e2) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:36.013016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb028034-fa1e-438f-afe3-48fe81c5da6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:36.015184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb028034-fa1e-438f-afe3-48fe81c5da6a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:36.021949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 71/137] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:35 2022] GET /identity/v3/role_assignments?user.id=f84dec4fa2c94078a58e79f5a4e6b4e2&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=0e2c092f713b413abc3ac9e75947878c => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:36.559260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb5496-fd1d-4745-b65e-a28d785cb290 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:36.559765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb5496-fd1d-4745-b65e-a28d785cb290 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:36.559839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb5496-fd1d-4745-b65e-a28d785cb290 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:36.562671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 67/138] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:36.568048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb85a79-91a9-4063-abea-7d7b849be46f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:36.568346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb85a79-91a9-4063-abea-7d7b849be46f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:36.568627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb85a79-91a9-4063-abea-7d7b849be46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:36.590715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1cb85a79-91a9-4063-abea-7d7b849be46f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:36.593011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1cb85a79-91a9-4063-abea-7d7b849be46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:36.681510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 72/139] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:36.704341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb5496-fd1d-4745-b65e-a28d785cb290 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:36.814159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb5496-fd1d-4745-b65e-a28d785cb290 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:36.850516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bb46f-88bd-4051-85e8-261275a23a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:36.851352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb46f-88bd-4051-85e8-261275a23a13 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:36.851639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb46f-88bd-4051-85e8-261275a23a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:36.851927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb46f-88bd-4051-85e8-261275a23a13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:36.863480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bb46f-88bd-4051-85e8-261275a23a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:36.870634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-2a1bb46f-88bd-4051-85e8-261275a23a13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:36.872154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 68/140] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:36.878682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb85a79-91a9-4063-abea-7d7b849be46f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:36.953893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2364-a7ca-43ce-84a1-727981661410 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:36.954194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2364-a7ca-43ce-84a1-727981661410 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:36.954471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2364-a7ca-43ce-84a1-727981661410 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:36.956648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 69/141] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:36.961389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2de16-ef21-44bb-a1d2-11d3e81e044e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:36.961691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2de16-ef21-44bb-a1d2-11d3e81e044e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:36.961980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2de16-ef21-44bb-a1d2-11d3e81e044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:36.988202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f1b2de16-ef21-44bb-a1d2-11d3e81e044e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:36.989485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f1b2de16-ef21-44bb-a1d2-11d3e81e044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:37.015663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb85a79-91a9-4063-abea-7d7b849be46f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:37.075378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:37.075997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:37.076376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:37.076652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:37.077413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:37.077719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:37.079158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:37.089647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 70/142] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:37.096674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 73/143] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:37.101941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2de16-ef21-44bb-a1d2-11d3e81e044e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:37.141137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:37.310235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2de16-ef21-44bb-a1d2-11d3e81e044e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:37.338416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241da610-4244-4ac0-93ef-35bf875de140 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:37.383085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:37.384209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:37.384651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:37.384940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] PATH_INFO: `/v3/users/214bd24980334d9c9b15c0df533aa535` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:37.390282 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] RBAC: Authorizing `identity:get_user(user_id=214bd24980334d9c9b15c0df533aa535)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:37.391967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:37.393626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 71/144] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:37 2022] GET /identity/v3/users/214bd24980334d9c9b15c0df533aa535 => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:37.399848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:37.416756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:37.417574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:37.417855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:37.418133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:37.423342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:37.424876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:37.426696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 74/145] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:37.432259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:37.540260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c7f8a-39ee-40b4-9624-95e1d24c7b0a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:37.577275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:37.578077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:37.578306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:37.578595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:37.617874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f59b9-4bef-42d8-b840-4967ca3d2b2d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:37.659602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:37.661290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:37.667360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:37.668064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:37.668351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:37.668635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:37.669377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:37.671539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:37.765591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 72/146] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:52:37.771203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:37.817352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 75/147] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:52:37 2022] POST /identity/v3/users => generated 283 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 17:52:37.876309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6b89-bd2e-49a3-812f-c6acf117e2a6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:37.916040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0f7ce-fc1d-46f8-bedf-ee2bb8b427bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:37.916983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0f7ce-fc1d-46f8-bedf-ee2bb8b427bf None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:37.917274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0f7ce-fc1d-46f8-bedf-ee2bb8b427bf None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:37.917561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0f7ce-fc1d-46f8-bedf-ee2bb8b427bf None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:37.918887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0f7ce-fc1d-46f8-bedf-ee2bb8b427bf None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:37.920427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0f7ce-fc1d-46f8-bedf-ee2bb8b427bf None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:37.922178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 73/148] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:37 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:37.928298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:38.058763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734ac12-9982-4c53-8d3b-92d2414178a4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:38.101953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebeaa2-76f9-4c4b-822c-a0862932c757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:38.102648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebeaa2-76f9-4c4b-822c-a0862932c757 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.102945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebeaa2-76f9-4c4b-822c-a0862932c757 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.103228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebeaa2-76f9-4c4b-822c-a0862932c757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.104075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebeaa2-76f9-4c4b-822c-a0862932c757 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=214bd24980334d9c9b15c0df533aa535) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:38.104394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebeaa2-76f9-4c4b-822c-a0862932c757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:38.105846 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebeaa2-76f9-4c4b-822c-a0862932c757 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:38.112529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 76/149] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:37 2022] GET /identity/v3/role_assignments?user.id=214bd24980334d9c9b15c0df533aa535&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:38.260337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033531e3-8fff-46b6-94d5-6175c4f3ff78 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.260672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033531e3-8fff-46b6-94d5-6175c4f3ff78 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.260910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033531e3-8fff-46b6-94d5-6175c4f3ff78 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.262991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 74/150] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:38.269274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d342-c061-4a5a-b3d3-277bc7ef2a14 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.269597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d342-c061-4a5a-b3d3-277bc7ef2a14 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.269887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d342-c061-4a5a-b3d3-277bc7ef2a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.288232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f832d342-c061-4a5a-b3d3-277bc7ef2a14 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:38.289477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f832d342-c061-4a5a-b3d3-277bc7ef2a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:38.373403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 77/151] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:38.400195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033531e3-8fff-46b6-94d5-6175c4f3ff78 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:38.515816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033531e3-8fff-46b6-94d5-6175c4f3ff78 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:38.550975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:38.551785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.552075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.552358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.563544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:38.570764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:38.571980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 75/152] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:38.578077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d342-c061-4a5a-b3d3-277bc7ef2a14 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:38.690042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d342-c061-4a5a-b3d3-277bc7ef2a14 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:38.729221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9bb0-76e6-4021-868d-c672c73ecf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:38.729906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9bb0-76e6-4021-868d-c672c73ecf0b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.730194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9bb0-76e6-4021-868d-c672c73ecf0b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.730477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9bb0-76e6-4021-868d-c672c73ecf0b None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.731282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d9bb0-76e6-4021-868d-c672c73ecf0b None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:38.731593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d9bb0-76e6-4021-868d-c672c73ecf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:38.733096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d9bb0-76e6-4021-868d-c672c73ecf0b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:38.744547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 78/153] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:38.750639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:38.796470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f645-0d6e-4aae-a185-6d968e211e58 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.796743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f645-0d6e-4aae-a185-6d968e211e58 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.796973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f645-0d6e-4aae-a185-6d968e211e58 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.799080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 79/154] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:38.807659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c65091-2279-404d-a29d-d890d53fda7b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.808222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c65091-2279-404d-a29d-d890d53fda7b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.808775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c65091-2279-404d-a29d-d890d53fda7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.827727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-73c65091-2279-404d-a29d-d890d53fda7b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:38.829719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-73c65091-2279-404d-a29d-d890d53fda7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:38.868066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f340b-272f-4015-8207-4261fed39a98 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:38.918767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:38.920535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:38.920826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:38.921110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:38.923665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:38.925158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:38.926942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 76/155] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:38 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:38.931119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 80/156] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:38.939608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:38.974565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c65091-2279-404d-a29d-d890d53fda7b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:39.049017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6394a-911d-44d9-93d9-b137f90c90d1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:39.085823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:39.086179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.086439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.086756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.158963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:39.160462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:39.251350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c65091-2279-404d-a29d-d890d53fda7b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:39.266899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 77/157] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:39.273859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:39.321245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:39.321991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.322273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.322547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.335638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:39.344458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:52:39.345892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 81/158] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:52:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:39.351822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:39.446837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed428-bbd9-464d-bf0c-9256c3ec8530 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:39.465617 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afa90e-ea7c-4870-9764-453e42e809d2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:39.502268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:39.503368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.503866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.504337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.505305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:39.505816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:39.507432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:39.518539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 82/159] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:52:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:39.524196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:39.524512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:39.525499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.525783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.526054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.527275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:39.528717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:39.531174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 78/160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:39 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:39.560434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:39.632977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7705b8-d65d-4b71-ba99-976176d0ea6e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:39.668345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:39.669597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.670283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.671033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.672919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:39.674654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:39.677337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 83/161] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:39 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:39.683809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:39.790195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa68b5-8bbf-47d3-a236-cc6eb1d1389f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:39.818147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e47f0-1eda-408f-b4d7-cb2a97e01f95 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:39.853911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad85eb4-0f28-473d-9175-f5b9a376cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:39.855358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad85eb4-0f28-473d-9175-f5b9a376cf08 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.856188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad85eb4-0f28-473d-9175-f5b9a376cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.857151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad85eb4-0f28-473d-9175-f5b9a376cf08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.857975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:39.859193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.860240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad85eb4-0f28-473d-9175-f5b9a376cf08 None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=87e005b975a34a64a110e48a187b85dd) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:39.860753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.861259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad85eb4-0f28-473d-9175-f5b9a376cf08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:39.861967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.864294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad85eb4-0f28-473d-9175-f5b9a376cf08 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:39.881125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 79/162] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:39 2022] GET /identity/v3/role_assignments?user.id=87e005b975a34a64a110e48a187b85dd&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:39.882824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3de5b-111b-4a32-a0a2-e7180297d42f None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.883369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3de5b-111b-4a32-a0a2-e7180297d42f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.883948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3de5b-111b-4a32-a0a2-e7180297d42f None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.888022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 80/163] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:39.890323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ed6b-2208-4aee-aab9-427c64de2ace None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.894902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ed6b-2208-4aee-aab9-427c64de2ace None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.895535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ed6b-2208-4aee-aab9-427c64de2ace None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.899111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 81/164] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:39.903387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f5dd-f79a-474e-8edc-6ee74763e454 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:39.905636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f5dd-f79a-474e-8edc-6ee74763e454 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:39.906381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f5dd-f79a-474e-8edc-6ee74763e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:39.946201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6298f5dd-f79a-474e-8edc-6ee74763e454 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:39.947795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6298f5dd-f79a-474e-8edc-6ee74763e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:40.010258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:40.012866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:40.133102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 82/165] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:40.134497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6adb9-b1b1-4b24-b9bc-bd3f6cfc9a8d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:40.134758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6adb9-b1b1-4b24-b9bc-bd3f6cfc9a8d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:40.135030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6adb9-b1b1-4b24-b9bc-bd3f6cfc9a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:40.136567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 84/166] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:52:40.142773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:40.165739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-69b6adb9-b1b1-4b24-b9bc-bd3f6cfc9a8d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:40.166934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-69b6adb9-b1b1-4b24-b9bc-bd3f6cfc9a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:40.242753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c7263-fcbb-4422-bc2d-8128676ab9df None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:40.277803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:40.279088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:40.280102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:40.280589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:40.282057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:40.283749 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:40.286023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 85/167] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:40.287027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:40.329112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 83/168] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:40.330059 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6adb9-b1b1-4b24-b9bc-bd3f6cfc9a8d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:40.395045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4d2f4-16d2-4dd1-8675-03c4582294d6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:40.430473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:40.431663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:40.432161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:40.432632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:40.444316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:40.453941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:52:40.456018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 86/169] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:40.457230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:40.568634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff0001-2c35-4cdc-b770-d30f3ee9b557 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:40.581254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6adb9-b1b1-4b24-b9bc-bd3f6cfc9a8d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:40.605454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:40.606637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:40.607121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:40.608252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:40.632765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:40.633445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:40.633722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:40.633998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:40.634861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] RBAC: Adding query filter params (role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=87e005b975a34a64a110e48a187b85dd) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:40.635170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:40.636610 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:40.639366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:40.646650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:40.651683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 84/170] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/role_assignments?user.id=87e005b975a34a64a110e48a187b85dd&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:40.652426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:40.654001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 87/171] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:40.661928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:40.864848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9970-2e2f-4bd4-902f-33d33c37bd5b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:40.877429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e3a8e-e91e-4231-90dc-5507a3bd990b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:40.917410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:40.918536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:40.919068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:40.919556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:40.920997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:40.921528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:40.923129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:40.933187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 88/172] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:40.937265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:40.938267 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:40.939393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:40.940247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:40.941099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:40.943810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:40.945049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:40.946665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:40.963860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 85/173] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:40.971171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:41.130360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c2fe5-75ad-4b5a-a00f-cfd629b5fc41 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:41.148683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545eeda6-a94a-434b-b63d-e8cce50507e7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:41.187739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:41.188954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:41.189434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:41.189904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] PATH_INFO: `/v3/users/f84dec4fa2c94078a58e79f5a4e6b4e2` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:41.191332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] RBAC: Authorizing `identity:get_user(user_id=f84dec4fa2c94078a58e79f5a4e6b4e2)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:41.192969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:41.193935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:41.194828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:41.195107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:41.195380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] PATH_INFO: `/v3/users/87e005b975a34a64a110e48a187b85dd` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:41.195959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 86/174] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/users/f84dec4fa2c94078a58e79f5a4e6b4e2 => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:41.196595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] RBAC: Authorizing `identity:get_user(user_id=87e005b975a34a64a110e48a187b85dd)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:41.198041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:41.202652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 89/175] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:40 2022] GET /identity/v3/users/87e005b975a34a64a110e48a187b85dd => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:41.209607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:41.209809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:41.314665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10018cf7-d344-4e45-8ac7-803e37cc2f24 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:41.349372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:41.350596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:41.351121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:41.351588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:41.352988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:41.354642 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:41.356540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 87/176] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:41 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:41.365035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:41.409167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290f75-ae82-4c1b-9fa2-34f04eaa95a2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:41.477588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:41.478648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:41.479152 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:41.479622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:41.557770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f238d9-7cb2-4f35-8ff3-8c425e7c1920 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:41.598729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:41.600195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:41.624425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:41.625387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:41.625668 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:41.625939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069/users/f84dec4fa2c94078a58e79f5a4e6b4e2/roles/0e2c092f713b413abc3ac9e75947878c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:41.630261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] RBAC: Authorizing `identity:create_grant(project_id=16004a326feb4230b6b46f54063e1069, user_id=f84dec4fa2c94078a58e79f5a4e6b4e2, role_id=0e2c092f713b413abc3ac9e75947878c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:41.632578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:41.711804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 88/177] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:41 2022] PUT /identity/v3/projects/16004a326feb4230b6b46f54063e1069/users/f84dec4fa2c94078a58e79f5a4e6b4e2/roles/0e2c092f713b413abc3ac9e75947878c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:52:41.733490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 90/178] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:52:41.740347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:41.869622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63d97-22e6-4aa5-a5f1-e930884ed65c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:41.915841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cad88-8bba-43c2-9cdf-a6f15d541b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:41.917109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cad88-8bba-43c2-9cdf-a6f15d541b47 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:41.917590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cad88-8bba-43c2-9cdf-a6f15d541b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:41.918046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cad88-8bba-43c2-9cdf-a6f15d541b47 None admin] PATH_INFO: `/v3/projects/9afcd906ab5e49519e631e62901bdf53` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:41.923330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cad88-8bba-43c2-9cdf-a6f15d541b47 None admin] RBAC: Authorizing `identity:get_project(project_id=9afcd906ab5e49519e631e62901bdf53)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:41.925148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cad88-8bba-43c2-9cdf-a6f15d541b47 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:41.927135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 89/179] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:41 2022] GET /identity/v3/projects/9afcd906ab5e49519e631e62901bdf53 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:41.933158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.083128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24f3a6-3f0b-4161-ae62-bfdefb17d003 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:42.118684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2ab9c-3351-4aac-b2c5-76643b9d4005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:42.119575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ab9c-3351-4aac-b2c5-76643b9d4005 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.119996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ab9c-3351-4aac-b2c5-76643b9d4005 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.120433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ab9c-3351-4aac-b2c5-76643b9d4005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.121404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ab9c-3351-4aac-b2c5-76643b9d4005 None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=9afcd906ab5e49519e631e62901bdf53, user.id=87e005b975a34a64a110e48a187b85dd) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:42.121864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ab9c-3351-4aac-b2c5-76643b9d4005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:42.123436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361d06d-4061-4ea4-81b5-0934e25ed085 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.123766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ab9c-3351-4aac-b2c5-76643b9d4005 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:42.123872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361d06d-4061-4ea4-81b5-0934e25ed085 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.124063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361d06d-4061-4ea4-81b5-0934e25ed085 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.126214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 90/180] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:42.130518 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 91/181] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:41 2022] GET /identity/v3/role_assignments?user.id=87e005b975a34a64a110e48a187b85dd&scope.project.id=9afcd906ab5e49519e631e62901bdf53&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:42.131426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970882f7-ec11-41fc-86c2-d67caf4efb3b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.131781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970882f7-ec11-41fc-86c2-d67caf4efb3b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.132127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970882f7-ec11-41fc-86c2-d67caf4efb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.167798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-970882f7-ec11-41fc-86c2-d67caf4efb3b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:42.169088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-970882f7-ec11-41fc-86c2-d67caf4efb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:42.224234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131ef9a-97be-4bd5-8726-0fa772cba994 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.224818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131ef9a-97be-4bd5-8726-0fa772cba994 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.225167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131ef9a-97be-4bd5-8726-0fa772cba994 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.228378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 92/182] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:42.239277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909d4d-48fe-41bc-9cf9-8a76bda224d5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.239656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909d4d-48fe-41bc-9cf9-8a76bda224d5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.240006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909d4d-48fe-41bc-9cf9-8a76bda224d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.282757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1e909d4d-48fe-41bc-9cf9-8a76bda224d5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:42.285570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1e909d4d-48fe-41bc-9cf9-8a76bda224d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:42.299653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 91/183] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:42.319910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970882f7-ec11-41fc-86c2-d67caf4efb3b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.398215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 93/184] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:42.399752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c60fa-7750-461f-8454-2f5ac064757a None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.400098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c60fa-7750-461f-8454-2f5ac064757a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.400377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c60fa-7750-461f-8454-2f5ac064757a None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.402457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 94/185] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:42.408247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e7ea-a8b8-43ae-a7d5-43f8f8c86846 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.408587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e7ea-a8b8-43ae-a7d5-43f8f8c86846 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.408843 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e7ea-a8b8-43ae-a7d5-43f8f8c86846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.427354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4851e7ea-a8b8-43ae-a7d5-43f8f8c86846 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:42.428700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4851e7ea-a8b8-43ae-a7d5-43f8f8c86846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:42.447558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970882f7-ec11-41fc-86c2-d67caf4efb3b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:42.488694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:42.490107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.490571 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.491058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.492794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:42.494923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:42.497050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 92/186] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:42.497994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.509986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 95/187] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:42.511083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e7ea-a8b8-43ae-a7d5-43f8f8c86846 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.613859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93456872-4f1d-4366-8fa6-e4fdde85726a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:42.622527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e7ea-a8b8-43ae-a7d5-43f8f8c86846 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:42.647349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:42.648498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.648980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.649457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.660708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:42.661113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:42.661375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.661652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.661921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.662672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:42.664093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:42.668966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:42.674993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 93/188] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:42.674993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.755810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 96/189] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:52:42 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:42.756606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.786939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5a7a-3761-4c41-902c-ecc9f45aa711 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:42.824989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:42.825820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.826103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.827394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.839143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:42.849355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:52:42.857124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 94/190] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:42.857124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.877486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d238-0373-4250-8698-05e1194d4c12 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:42.914038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:42.914750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:42.915031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:42.915304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:42.916071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:42.916377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:42.917785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:42.927564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 97/191] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:42.933156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:42.968639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb193cd-aec5-4375-a672-a3216639d548 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.009245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.010431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.010431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.010646 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.011447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:43.011755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.013130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.023725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 95/192] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:43.028256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:43.050397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b41c-3447-4711-ba04-b7cfd8ccf590 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.103883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.104779 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.105059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.105330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] PATH_INFO: `/v3/users/6d053c1ae71c42698cc7c8d4b70bab54` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.124276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] RBAC: Authorizing `identity:get_user(user_id=6d053c1ae71c42698cc7c8d4b70bab54)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.125793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.128053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 98/193] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:42 2022] GET /identity/v3/users/6d053c1ae71c42698cc7c8d4b70bab54 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:43.133345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:43.168639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae81c7-8028-496b-aa95-e5e9ae6496b6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.223464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.225469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.225896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.226344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] PATH_INFO: `/v3/users/6d053c1ae71c42698cc7c8d4b70bab54` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.228562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] RBAC: Authorizing `identity:get_user(user_id=6d053c1ae71c42698cc7c8d4b70bab54)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.230164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.231978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 96/194] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:43 2022] GET /identity/v3/users/6d053c1ae71c42698cc7c8d4b70bab54 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:43.239648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:43.258250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437aaba-3434-44c7-b998-3bc1bad1f361 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.293567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.294460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.294909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.295938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.364527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efd6bc-7d08-431a-a7ca-801503d02096 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.368282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.369350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.420805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.421386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.421667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.421941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.516358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 99/195] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:52:43.521758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:43.539746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.541276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.681309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f4f4-89e9-4b63-99b1-a52da3984b12 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.722387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 97/196] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:43.728496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:43.730238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.731247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.731530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.731803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.734283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.735795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.738108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 100/197] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:43 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:43.744992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:43.846410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19dc0d-9ca5-4b6e-9060-2bffdc0bf8b8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.882112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.882800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.883078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.883351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.884176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=6d053c1ae71c42698cc7c8d4b70bab54) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:43.884480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.885898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.891567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 101/198] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:43 2022] GET /identity/v3/role_assignments?user.id=6d053c1ae71c42698cc7c8d4b70bab54&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:43.922863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116383-804d-48ea-b0bf-e2d792201cc7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:43.981997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb77d9-a12e-428a-9f1e-0910744dc872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:43.983826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb77d9-a12e-428a-9f1e-0910744dc872 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:43.984345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb77d9-a12e-428a-9f1e-0910744dc872 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:43.984820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb77d9-a12e-428a-9f1e-0910744dc872 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:43.991581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb77d9-a12e-428a-9f1e-0910744dc872 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:43.993395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb77d9-a12e-428a-9f1e-0910744dc872 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:43.995877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 98/199] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:43 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:44.002224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:44.140858 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742781d1-52e2-403d-b297-f2dcc24b1143 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:44.184915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e9670-3e7d-489f-b59e-4057ac5d760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:44.186045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e9670-3e7d-489f-b59e-4057ac5d760b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:44.186561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e9670-3e7d-489f-b59e-4057ac5d760b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:44.187069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e9670-3e7d-489f-b59e-4057ac5d760b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:44.188149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e9670-3e7d-489f-b59e-4057ac5d760b None admin] RBAC: Adding query filter params (role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=6d053c1ae71c42698cc7c8d4b70bab54) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:44.188680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e9670-3e7d-489f-b59e-4057ac5d760b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:44.190397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e9670-3e7d-489f-b59e-4057ac5d760b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:44.197147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 102/200] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:44 2022] GET /identity/v3/role_assignments?user.id=6d053c1ae71c42698cc7c8d4b70bab54&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:44.595542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697698-c3f3-4e0f-8195-b19b1934d0e7 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:44.596176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697698-c3f3-4e0f-8195-b19b1934d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:44.596672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697698-c3f3-4e0f-8195-b19b1934d0e7 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:44.598704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 99/201] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:44.604344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abc163-0dcb-4e98-bc63-65b8e456c35b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:44.604643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abc163-0dcb-4e98-bc63-65b8e456c35b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:44.604929 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abc163-0dcb-4e98-bc63-65b8e456c35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:44.626951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b5abc163-0dcb-4e98-bc63-65b8e456c35b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:44.628142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b5abc163-0dcb-4e98-bc63-65b8e456c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:44.707598 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 103/202] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:44.746500 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3697698-c3f3-4e0f-8195-b19b1934d0e7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:44.884326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3697698-c3f3-4e0f-8195-b19b1934d0e7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:44.930264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:44.931098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:44.931376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:44.931646 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:44.945661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:44.953297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:52:44.958713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 100/203] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:52:44.960572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abc163-0dcb-4e98-bc63-65b8e456c35b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:45.138303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abc163-0dcb-4e98-bc63-65b8e456c35b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:45.184273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:45.185709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.186310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.186826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:45.187789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:45.188287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:45.189846 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:45.198914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 104/204] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:45.205923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:45.321771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fa6e3-43fb-4964-985e-f974702a6608 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:45.359246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d83bab-c7bc-4095-a8a9-1cfbe0988d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:45.360509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d83bab-c7bc-4095-a8a9-1cfbe0988d81 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.361034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d83bab-c7bc-4095-a8a9-1cfbe0988d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.361523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d83bab-c7bc-4095-a8a9-1cfbe0988d81 None admin] PATH_INFO: `/v3/users/f84dec4fa2c94078a58e79f5a4e6b4e2` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:45.363466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d83bab-c7bc-4095-a8a9-1cfbe0988d81 None admin] RBAC: Authorizing `identity:get_user(user_id=f84dec4fa2c94078a58e79f5a4e6b4e2)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:45.365259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d83bab-c7bc-4095-a8a9-1cfbe0988d81 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:45.367596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 101/205] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:45 2022] GET /identity/v3/users/f84dec4fa2c94078a58e79f5a4e6b4e2 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:45.374342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:45.491205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3de95-acb6-4f08-8f0e-66b093e0ce09 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:45.539137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dc477-ac71-4a71-89e0-203f08463a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:45.539862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dc477-ac71-4a71-89e0-203f08463a41 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.540149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dc477-ac71-4a71-89e0-203f08463a41 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.540427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dc477-ac71-4a71-89e0-203f08463a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:45.636931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dc477-ac71-4a71-89e0-203f08463a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:45.638422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dc477-ac71-4a71-89e0-203f08463a41 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:45.645290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cb641-8441-4fd2-ae26-79dc29c28eb1 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.645578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cb641-8441-4fd2-ae26-79dc29c28eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.645855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cb641-8441-4fd2-ae26-79dc29c28eb1 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:45.647838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 102/206] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:45.652749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ea474-12b7-4d54-a164-c46a3e278ce5 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.653032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ea474-12b7-4d54-a164-c46a3e278ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.653308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ea474-12b7-4d54-a164-c46a3e278ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:45.710109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-985ea474-12b7-4d54-a164-c46a3e278ce5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:45.710109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-985ea474-12b7-4d54-a164-c46a3e278ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:45.815739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 103/207] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:45.829135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 105/208] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:45.834603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ea474-12b7-4d54-a164-c46a3e278ce5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:45.852489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1ef5b-893c-45d9-84fe-4bac3ef3a245 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.852787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1ef5b-893c-45d9-84fe-4bac3ef3a245 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.853041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1ef5b-893c-45d9-84fe-4bac3ef3a245 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:45.856463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 106/209] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:45.856463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1ef5b-893c-45d9-84fe-4bac3ef3a245 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:45.939973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ea474-12b7-4d54-a164-c46a3e278ce5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:45.976680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9decc33-678a-482b-8857-6ab344aebf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:45.977874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9decc33-678a-482b-8857-6ab344aebf60 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.978346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9decc33-678a-482b-8857-6ab344aebf60 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.978840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9decc33-678a-482b-8857-6ab344aebf60 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:45.980538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9decc33-678a-482b-8857-6ab344aebf60 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:45.980704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1ef5b-893c-45d9-84fe-4bac3ef3a245 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:45.982266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9decc33-678a-482b-8857-6ab344aebf60 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:45.984632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 104/210] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:45 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:45.985968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91320b9-1162-4f44-bf52-c0da68a6f7d5 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:45.986461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91320b9-1162-4f44-bf52-c0da68a6f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:45.986976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91320b9-1162-4f44-bf52-c0da68a6f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.004514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c91320b9-1162-4f44-bf52-c0da68a6f7d5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:46.005964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c91320b9-1162-4f44-bf52-c0da68a6f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:46.031753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:46.033072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.033509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.034056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.036006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:46.038095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:46.040902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 107/211] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:46.041798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:46.093593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 105/212] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:46.095248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91320b9-1162-4f44-bf52-c0da68a6f7d5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:46.169564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6b732-6d33-46d4-a1bd-acbf8ce5e41a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:46.204916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:46.206355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.206857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.207328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.208378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] RBAC: Adding query filter params (role.id=0e2c092f713b413abc3ac9e75947878c, scope.project.id=16004a326feb4230b6b46f54063e1069, user.id=f84dec4fa2c94078a58e79f5a4e6b4e2) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:46.208882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:46.210505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:46.216640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 108/213] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:46 2022] GET /identity/v3/role_assignments?user.id=f84dec4fa2c94078a58e79f5a4e6b4e2&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=0e2c092f713b413abc3ac9e75947878c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:46.222643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:46.222834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91320b9-1162-4f44-bf52-c0da68a6f7d5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:46.270074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:46.270802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.271093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.271359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.272088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:46.275259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:46.378945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00fc6a-39f2-4c62-9d44-f9c7360cdb6a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:46.410005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 106/214] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:52:46 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:46.433946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:46.434790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.435067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.435386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.450503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:46.460952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:46.471381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 109/215] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:46.471517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:46.585839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b08f-11f0-435a-9483-f71f8920dac6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:46.623199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:46.624363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.624858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.625315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.626293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:46.626824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:46.628540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:46.638510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 107/216] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:46.645141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:46.762140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e90a4-669f-4f8c-bcbe-e0d707e1561c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:46.795591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c291cab-c513-4b83-8d56-19678ac2b803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:46.796475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c291cab-c513-4b83-8d56-19678ac2b803 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.796758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c291cab-c513-4b83-8d56-19678ac2b803 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.797034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c291cab-c513-4b83-8d56-19678ac2b803 None admin] PATH_INFO: `/v3/users/e08fde2c1f614140b432b9eaab0d1c99` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.812505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c291cab-c513-4b83-8d56-19678ac2b803 None admin] RBAC: Authorizing `identity:get_user(user_id=e08fde2c1f614140b432b9eaab0d1c99)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:46.814033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c291cab-c513-4b83-8d56-19678ac2b803 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:46.816102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 110/217] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:46 2022] GET /identity/v3/users/e08fde2c1f614140b432b9eaab0d1c99 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:46.821329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:46.892156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b566e41-779b-44bc-8df0-f3599d62787f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.892648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b566e41-779b-44bc-8df0-f3599d62787f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.893101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b566e41-779b-44bc-8df0-f3599d62787f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.895420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 111/218] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:46.905269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe4206-6368-42e9-965b-f91b7ea9d894 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:46.905900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe4206-6368-42e9-965b-f91b7ea9d894 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:46.906418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe4206-6368-42e9-965b-f91b7ea9d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:46.930399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ccbe4206-6368-42e9-965b-f91b7ea9d894 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:46.932418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ccbe4206-6368-42e9-965b-f91b7ea9d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:46.938056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2396fe-931d-4668-b20a-55f06c424dcc None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.012617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.013521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.013979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.014509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.039603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 112/219] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:47.041738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e630d-6cfd-4716-90d9-556a262f1296 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.042227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e630d-6cfd-4716-90d9-556a262f1296 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.042668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e630d-6cfd-4716-90d9-556a262f1296 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.044972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 113/220] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:47.060544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e8d1-8972-4126-b402-fe239cb0e61f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.060658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e8d1-8972-4126-b402-fe239cb0e61f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.060845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e8d1-8972-4126-b402-fe239cb0e61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.079041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a0f9e8d1-8972-4126-b402-fe239cb0e61f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:47.080225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a0f9e8d1-8972-4126-b402-fe239cb0e61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:47.097292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:47.099007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:47.149414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 114/221] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:47.155472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9e8d1-8972-4126-b402-fe239cb0e61f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.200911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 108/222] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:47.202754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.282450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9e8d1-8972-4126-b402-fe239cb0e61f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.306244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ac9e5-6ca1-443f-91a1-3c43c8a3ed29 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.317437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.318450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.318965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.319379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.330254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:47.337508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:47.339113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 115/223] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:47.340030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.340143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.341086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.341369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.341643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.352201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:47.360194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:52:47.361547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 109/224] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:47.362161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.443464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1d19-5e56-4329-9413-38594c274781 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.468039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b215bf-ad72-4607-b074-bc726bfcb817 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.477518 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.478553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.479001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.479434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.480807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:47.482490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:47.485220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 116/225] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:47.486138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.511844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.513109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.513538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.513956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.515093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:47.516061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:47.518132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:47.530825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 110/226] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:47.531987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.606126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf42dbc-7192-4b4a-9270-d4d9d7ef2c52 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.640654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.641328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.641608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.641881 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.642666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:47.642970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:47.644429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:47.652769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 117/227] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:47.653694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.655793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbc4d-d10d-4063-877c-6efff2fc9696 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.692493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.693150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.693430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.693752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.694527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=e08fde2c1f614140b432b9eaab0d1c99) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:47.694878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:47.696596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:47.702046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 111/228] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/role_assignments?user.id=e08fde2c1f614140b432b9eaab0d1c99&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:47.702914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.784098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d40c2-28bf-4aee-8726-402b59cd0b0d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.821242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b7f9c-38ea-40d2-a77d-005fcb39babb None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:47.854836 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.855732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.856010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.856279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] PATH_INFO: `/v3/users/6d053c1ae71c42698cc7c8d4b70bab54` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.858934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] RBAC: Authorizing `identity:get_user(user_id=6d053c1ae71c42698cc7c8d4b70bab54)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:47.860426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:47.862584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 118/229] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/users/6d053c1ae71c42698cc7c8d4b70bab54 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:47.868228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:47.901803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:47.902856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:47.903136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:47.903408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] PATH_INFO: `/v3/users/6d053c1ae71c42698cc7c8d4b70bab54` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:47.906108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] RBAC: Authorizing `identity:get_user(user_id=6d053c1ae71c42698cc7c8d4b70bab54)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:47.907615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:47.914660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 112/230] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/users/6d053c1ae71c42698cc7c8d4b70bab54 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:47.923682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:48.017670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85597e7-2920-46dc-b828-92cdbb3057df None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:48.073128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:48.073998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:48.074274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:48.074545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:48.077623 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:48.079229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:48.083146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 119/231] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:48.087739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:48.114256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce3a7-d223-4ee6-8d84-85aedf3725cf None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:48.175292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:48.176162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:48.176440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:48.176709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:48.177994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:48.179460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:48.181141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 113/232] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:47 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:48.189029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:48.245325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cea44-7724-42c6-8014-b704aeb5ffb8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:48.303952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed388ba9-eb6a-4726-9668-95600d016e36 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:48.320038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a4e7d-7d31-4243-beaa-63f9195dcead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:48.320981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a4e7d-7d31-4243-beaa-63f9195dcead None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:48.321267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a4e7d-7d31-4243-beaa-63f9195dcead None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:48.321540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a4e7d-7d31-4243-beaa-63f9195dcead None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082/users/6d053c1ae71c42698cc7c8d4b70bab54/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:48.326394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a4e7d-7d31-4243-beaa-63f9195dcead None admin] RBAC: Authorizing `identity:create_grant(project_id=2c7efcccade14922af9a4a4425790082, user_id=6d053c1ae71c42698cc7c8d4b70bab54, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:48.328734 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a4e7d-7d31-4243-beaa-63f9195dcead None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:48.343244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a7458-bbbb-4005-aa42-3477f71fa406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:48.352091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7458-bbbb-4005-aa42-3477f71fa406 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:48.352091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7458-bbbb-4005-aa42-3477f71fa406 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:48.352091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7458-bbbb-4005-aa42-3477f71fa406 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082/users/6d053c1ae71c42698cc7c8d4b70bab54/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:48.352091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7458-bbbb-4005-aa42-3477f71fa406 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c7efcccade14922af9a4a4425790082, user_id=6d053c1ae71c42698cc7c8d4b70bab54, role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:48.352091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7458-bbbb-4005-aa42-3477f71fa406 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:48.398235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 120/233] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:48 2022] PUT /identity/v3/projects/2c7efcccade14922af9a4a4425790082/users/6d053c1ae71c42698cc7c8d4b70bab54/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:52:48.422194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 114/234] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:48 2022] PUT /identity/v3/projects/2c7efcccade14922af9a4a4425790082/users/6d053c1ae71c42698cc7c8d4b70bab54/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:52:49.187420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5e27-8a73-4c18-a88a-0f5d52eda693 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.187864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5e27-8a73-4c18-a88a-0f5d52eda693 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.188087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5e27-8a73-4c18-a88a-0f5d52eda693 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.189733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 121/235] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:49.195379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879de5-1aa9-48c5-9aee-c69bbee84f77 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.195671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879de5-1aa9-48c5-9aee-c69bbee84f77 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.195951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879de5-1aa9-48c5-9aee-c69bbee84f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.223638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-39879de5-1aa9-48c5-9aee-c69bbee84f77 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:49.224828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-39879de5-1aa9-48c5-9aee-c69bbee84f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:49.306878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 115/236] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:49.327938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed9d67-63ae-4ca2-a06e-cd9766f246fb None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.328516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed9d67-63ae-4ca2-a06e-cd9766f246fb None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.328516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed9d67-63ae-4ca2-a06e-cd9766f246fb None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.330324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 122/237] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:49.335224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940544af-a3ca-431e-bff3-65dbc28b0ed3 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.335512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940544af-a3ca-431e-bff3-65dbc28b0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.335789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940544af-a3ca-431e-bff3-65dbc28b0ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.346703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed9d67-63ae-4ca2-a06e-cd9766f246fb None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:49.364878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-940544af-a3ca-431e-bff3-65dbc28b0ed3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:49.366055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-940544af-a3ca-431e-bff3-65dbc28b0ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:49.464016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 116/238] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:49.488820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940544af-a3ca-431e-bff3-65dbc28b0ed3 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:49.539974 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed9d67-63ae-4ca2-a06e-cd9766f246fb None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:49.597445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940544af-a3ca-431e-bff3-65dbc28b0ed3 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:49.604254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:49.605424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.605987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.606490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.627775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:49.633425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:49.634235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.634518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.642634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.642634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:49.642634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:49.642634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 117/239] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:49.644509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:52:49.644858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:49.646227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 123/240] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:52:49.651872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:49.746999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4d115-55db-47f8-8c5d-692bb4023d07 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:49.781742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:49.782428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.782735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.783015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.783732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:49.785366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:49.830753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083f2e1-4489-4fcb-a5b1-165796304d46 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:49.869953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:49.871638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:49.872780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:49.873304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:49.875371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:49.876983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:49.878134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 118/241] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:52:49 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 17:52:49.879283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:49.890180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 124/242] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:49.895933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:50.051434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7fe5b-f483-45cf-8311-539dcd49c99a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:50.099965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb90f4-004f-4197-9d4c-500057b3c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:50.101176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb90f4-004f-4197-9d4c-500057b3c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.101632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb90f4-004f-4197-9d4c-500057b3c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.102080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb90f4-004f-4197-9d4c-500057b3c7b8 None admin] PATH_INFO: `/v3/users/7e02fda0476f45e7a1269a996c59c0ea` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.117799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb90f4-004f-4197-9d4c-500057b3c7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7e02fda0476f45e7a1269a996c59c0ea)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:50.119579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb90f4-004f-4197-9d4c-500057b3c7b8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:50.121535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 119/243] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:49 2022] GET /identity/v3/users/7e02fda0476f45e7a1269a996c59c0ea => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:50.127910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:50.275937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f85197-82a6-4fce-a0b3-3ee5719cef2e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:50.319524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:50.320181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.320458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.320727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.395925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:50.397391 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:50.428269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9aef-3584-4071-8a0b-d4067c00982c None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.429190 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9aef-3584-4071-8a0b-d4067c00982c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.429661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9aef-3584-4071-8a0b-d4067c00982c None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.431673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 120/244] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:50.437285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268672-ff1e-4059-9042-732c4ab14c30 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.437566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268672-ff1e-4059-9042-732c4ab14c30 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.437848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268672-ff1e-4059-9042-732c4ab14c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.462594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-12268672-ff1e-4059-9042-732c4ab14c30 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:50.464103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-12268672-ff1e-4059-9042-732c4ab14c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:50.509185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 125/245] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:50.509185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:50.549210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 121/246] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:50.573967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12268672-ff1e-4059-9042-732c4ab14c30 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:50.620374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df951a-f9fd-427f-94b6-56cbaa62534e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:50.655753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:50.656654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.656934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.657205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.658429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:50.659923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:50.666390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 126/247] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:50 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:50.667713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:50.692228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12268672-ff1e-4059-9042-732c4ab14c30 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:50.727491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:50.728716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.729208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.729676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.741143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:50.749580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:50.751136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 122/248] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:52:50.756932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:50.803189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edf76c-2e50-45c9-ba3a-c51122376f03 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:50.893065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:50.893733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.894022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.894295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.895164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] RBAC: Adding query filter params (role.id=0e2c092f713b413abc3ac9e75947878c, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=7e02fda0476f45e7a1269a996c59c0ea) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:50.895472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:50.896906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:50.910083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 127/249] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:50 2022] GET /identity/v3/role_assignments?user.id=7e02fda0476f45e7a1269a996c59c0ea&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=0e2c092f713b413abc3ac9e75947878c => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:50.927365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fce3f-6d19-40a3-8bd1-093d3da17b4e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:50.964522 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:50.965647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:50.966131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:50.966635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:50.967773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:50.968293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:50.969906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:50.979495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 123/250] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:50.986074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:51.146882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf2b8-13ac-4f6e-bce2-40547c2c9ad6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:51.191853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268b08-b7be-4f71-a28e-eb721cb4f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:51.192647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268b08-b7be-4f71-a28e-eb721cb4f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:51.192925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268b08-b7be-4f71-a28e-eb721cb4f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:51.193196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268b08-b7be-4f71-a28e-eb721cb4f9c7 None admin] PATH_INFO: `/v3/users/e08fde2c1f614140b432b9eaab0d1c99` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:51.199422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268b08-b7be-4f71-a28e-eb721cb4f9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=e08fde2c1f614140b432b9eaab0d1c99)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:51.200887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268b08-b7be-4f71-a28e-eb721cb4f9c7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:51.203252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 128/251] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:50 2022] GET /identity/v3/users/e08fde2c1f614140b432b9eaab0d1c99 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:51.209343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:51.239113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7873-b7a8-4cbb-a20a-cc7d66ff7eef None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:51.239417 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7873-b7a8-4cbb-a20a-cc7d66ff7eef None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:51.239669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7873-b7a8-4cbb-a20a-cc7d66ff7eef None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:51.241726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 129/252] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:51.257124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d52145-412b-4745-b7f2-303a52111c46 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:51.257427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d52145-412b-4745-b7f2-303a52111c46 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:51.257680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d52145-412b-4745-b7f2-303a52111c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:51.292296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-99d52145-412b-4745-b7f2-303a52111c46 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:51.293505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-99d52145-412b-4745-b7f2-303a52111c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:51.370250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff39fae-d937-48bb-a518-b8170aae92d6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:51.386740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 130/253] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:51.411150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d52145-412b-4745-b7f2-303a52111c46 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:51.427070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:51.428280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:51.428723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:51.429581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:51.431175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:51.432865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:51.435175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 124/254] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:51 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:51.441487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:51.516787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d52145-412b-4745-b7f2-303a52111c46 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:51.553894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:51.554828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:51.555174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:51.555531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:51.555827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100eeab-1dc8-4faf-8d85-41b453496392 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:51.567068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:51.574049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:52:51.580471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 131/255] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:52:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:51.581877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:51.593304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:51.594578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:51.595088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:51.595598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082/users/e08fde2c1f614140b432b9eaab0d1c99/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:51.597928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] RBAC: Authorizing `identity:create_grant(project_id=2c7efcccade14922af9a4a4425790082, user_id=e08fde2c1f614140b432b9eaab0d1c99, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:51.599658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:51.687274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 125/256] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:51 2022] PUT /identity/v3/projects/2c7efcccade14922af9a4a4425790082/users/e08fde2c1f614140b432b9eaab0d1c99/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:52:51.750285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1b18-99f3-450d-a3d7-284b7f878a52 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:51.811732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25595-57b3-47b3-863b-271cc2f3d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:51.812777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25595-57b3-47b3-863b-271cc2f3d193 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:51.813230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25595-57b3-47b3-863b-271cc2f3d193 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:51.813712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25595-57b3-47b3-863b-271cc2f3d193 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:51.815037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25595-57b3-47b3-863b-271cc2f3d193 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:51.815575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25595-57b3-47b3-863b-271cc2f3d193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:51.818124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25595-57b3-47b3-863b-271cc2f3d193 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:51.838431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 132/257] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:51.843480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.001295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3c6e-1489-44b1-be59-e985eacb0fe9 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.001998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3c6e-1489-44b1-be59-e985eacb0fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.002480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3c6e-1489-44b1-be59-e985eacb0fe9 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.005864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 133/258] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:52.008673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8cc0-5f37-4ca2-82b9-7eb5c6ba3f3e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:52.010478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a074ada-6319-4a62-988a-7e7cd945f52b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.011014 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a074ada-6319-4a62-988a-7e7cd945f52b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.011541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a074ada-6319-4a62-988a-7e7cd945f52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.030734 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7a074ada-6319-4a62-988a-7e7cd945f52b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:52.032403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7a074ada-6319-4a62-988a-7e7cd945f52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:52.076333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:52.077374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.077662 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.077940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] PATH_INFO: `/v3/users/6d053c1ae71c42698cc7c8d4b70bab54` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.083377 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] RBAC: Authorizing `identity:get_user(user_id=6d053c1ae71c42698cc7c8d4b70bab54)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:52.085041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:52.089355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 126/259] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:51 2022] GET /identity/v3/users/6d053c1ae71c42698cc7c8d4b70bab54 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:52.110337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.112561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 134/260] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:52.136584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a074ada-6319-4a62-988a-7e7cd945f52b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.238487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a074ada-6319-4a62-988a-7e7cd945f52b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:52.274984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:52.276164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.276637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.277101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.288297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:52.296832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:52:52.302260 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 135/261] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:52:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:52.304472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.336677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce05ba-f074-4df8-a609-b3af312e168e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:52.406536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5d9b-9065-41d8-a4c6-d8fdf952f7c8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:52.432422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:52.433096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.433380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.433655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.445512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:52.446879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.447391 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.448005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.448834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:52.449214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:52.450734 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:52.460540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 136/262] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:52:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:52.466158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.518010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:52.520095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:52.573972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d70e-e466-4e16-884e-8d54f3dc6efa None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:52.623025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:52.624930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.626861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.628130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] PATH_INFO: `/v3/users/6d053c1ae71c42698cc7c8d4b70bab54` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.630466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] RBAC: Authorizing `identity:get_user(user_id=6d053c1ae71c42698cc7c8d4b70bab54)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:52.633228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:52.638757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 137/263] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:52 2022] GET /identity/v3/users/6d053c1ae71c42698cc7c8d4b70bab54 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:52.645591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.663650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 127/264] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:52.670252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.815883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05f05-d290-4af7-bc4c-5a4794b660d8 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:52.833675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a1ad-82e5-498e-8a93-3e3a13586079 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:52.885807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:52.887004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.887799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.888498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:52.890580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:52.896935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:52.899503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 128/265] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:52 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:52.905807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:52.923354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:52.924020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:52.924299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:52.924574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:53.042703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0c23-9e18-46f9-be5f-082dd9769b43 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:53.087688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:53.089136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:53.091595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:53.092974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:53.093431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:53.093984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:53.095025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=6d053c1ae71c42698cc7c8d4b70bab54) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:53.096362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:53.098050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:53.105240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 129/266] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:52 2022] GET /identity/v3/role_assignments?user.id=6d053c1ae71c42698cc7c8d4b70bab54&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:53.250353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 138/267] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:52:53.256068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:53.434942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3414-4bc2-49dc-a28c-a047d8116ba2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:53.476162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90efa-2c9e-46e7-8ca2-f12ab7856e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:53.477037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90efa-2c9e-46e7-8ca2-f12ab7856e9f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:53.477319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90efa-2c9e-46e7-8ca2-f12ab7856e9f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:53.477586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90efa-2c9e-46e7-8ca2-f12ab7856e9f None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:53.483957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec90efa-2c9e-46e7-8ca2-f12ab7856e9f None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:53.485609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec90efa-2c9e-46e7-8ca2-f12ab7856e9f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:53.488014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 130/268] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:53 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:53.493823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:53.613735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea906a5-d6e1-48cb-9551-68da628bc146 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:53.655787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9377fd-d071-4320-bf48-570e0d6c5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:53.656438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9377fd-d071-4320-bf48-570e0d6c5f91 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:53.656710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9377fd-d071-4320-bf48-570e0d6c5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:53.656969 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9377fd-d071-4320-bf48-570e0d6c5f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:53.657793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9377fd-d071-4320-bf48-570e0d6c5f91 None admin] RBAC: Adding query filter params (role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=6d053c1ae71c42698cc7c8d4b70bab54) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:53.658098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9377fd-d071-4320-bf48-570e0d6c5f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:53.659561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9377fd-d071-4320-bf48-570e0d6c5f91 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:53.671705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 139/269] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:53 2022] GET /identity/v3/role_assignments?user.id=6d053c1ae71c42698cc7c8d4b70bab54&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:54.118648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b231-f95b-4db4-b870-4df96c51114c None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.118969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b231-f95b-4db4-b870-4df96c51114c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.119233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b231-f95b-4db4-b870-4df96c51114c None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.121317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 131/270] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:54.127259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2397c-9f00-4012-8444-d7af66a669a0 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.127549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2397c-9f00-4012-8444-d7af66a669a0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.127833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2397c-9f00-4012-8444-d7af66a669a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.146918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-3fd2397c-9f00-4012-8444-d7af66a669a0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:54.148100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3fd2397c-9f00-4012-8444-d7af66a669a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:54.240588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 140/271] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:54.263117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b231-f95b-4db4-b870-4df96c51114c None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:54.277484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b0cc5-8b70-4f63-99f9-fe31485e45de None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.277777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b0cc5-8b70-4f63-99f9-fe31485e45de None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.278051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b0cc5-8b70-4f63-99f9-fe31485e45de None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.280749 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 141/272] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:54.285781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278b568-82ce-4946-81ce-cdd5d6561272 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.286241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278b568-82ce-4946-81ce-cdd5d6561272 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.286691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278b568-82ce-4946-81ce-cdd5d6561272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.303920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0278b568-82ce-4946-81ce-cdd5d6561272 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:54.305376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0278b568-82ce-4946-81ce-cdd5d6561272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:54.369684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b231-f95b-4db4-b870-4df96c51114c None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:54.376815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 142/273] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:54.402326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278b568-82ce-4946-81ce-cdd5d6561272 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:54.412381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:54.414109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.414547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.414993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.428489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:54.439045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:54.442331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 132/274] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:54.452040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:54.518237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278b568-82ce-4946-81ce-cdd5d6561272 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:54.553322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1154d-a23b-4308-9819-944a71687dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:54.554510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1154d-a23b-4308-9819-944a71687dbf None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.555040 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1154d-a23b-4308-9819-944a71687dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.555516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1154d-a23b-4308-9819-944a71687dbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.556127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372dc45-fa57-4c5b-8a59-b52e63c71cb0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:54.557112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1154d-a23b-4308-9819-944a71687dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:54.558817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1154d-a23b-4308-9819-944a71687dbf None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:54.560658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 143/275] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:54.568242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18500-193a-433d-be6c-81320ad8b4f0 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.568525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18500-193a-433d-be6c-81320ad8b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.568853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18500-193a-433d-be6c-81320ad8b4f0 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.570761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 144/276] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:54.571313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18500-193a-433d-be6c-81320ad8b4f0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:54.591736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdafe5a-86bf-408f-b0a4-1c0d44c9d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:54.592728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdafe5a-86bf-408f-b0a4-1c0d44c9d44e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.593012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdafe5a-86bf-408f-b0a4-1c0d44c9d44e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.593285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdafe5a-86bf-408f-b0a4-1c0d44c9d44e None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.594125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdafe5a-86bf-408f-b0a4-1c0d44c9d44e None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:54.594391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdafe5a-86bf-408f-b0a4-1c0d44c9d44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:54.595754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdafe5a-86bf-408f-b0a4-1c0d44c9d44e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:54.608628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 133/277] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:54.610003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5879f-fea1-472c-ae98-a4d9fccac778 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.610292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5879f-fea1-472c-ae98-a4d9fccac778 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.610570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5879f-fea1-472c-ae98-a4d9fccac778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.627848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d9b5879f-fea1-472c-ae98-a4d9fccac778 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:54.628950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d9b5879f-fea1-472c-ae98-a4d9fccac778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:54.679497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18500-193a-433d-be6c-81320ad8b4f0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:54.695200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 134/278] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:54.696248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5879f-fea1-472c-ae98-a4d9fccac778 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:54.723202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:54.724090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.724382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.724657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.725375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:54.726921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:54.792745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5879f-fea1-472c-ae98-a4d9fccac778 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:54.813462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 145/279] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:52:54 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:54.814360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:54.829798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46212d-03c2-4cee-8625-c6296568e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:54.830894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46212d-03c2-4cee-8625-c6296568e992 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.831178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46212d-03c2-4cee-8625-c6296568e992 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.831451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46212d-03c2-4cee-8625-c6296568e992 None admin] PATH_INFO: `/v3/users/12ca929cd0e746f3b3d22e0997f1428c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.847099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46212d-03c2-4cee-8625-c6296568e992 None admin] RBAC: Authorizing `identity:get_user(user_id=12ca929cd0e746f3b3d22e0997f1428c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:54.848644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46212d-03c2-4cee-8625-c6296568e992 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:54.850495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 135/280] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:54 2022] GET /identity/v3/users/12ca929cd0e746f3b3d22e0997f1428c => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:54.851845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df5af-799d-4561-91bc-ac086571085b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.852127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df5af-799d-4561-91bc-ac086571085b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.852412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df5af-799d-4561-91bc-ac086571085b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.854644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 136/281] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:54.856424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df5af-799d-4561-91bc-ac086571085b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:54.934667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b844-957f-4843-b0e7-d8a73a90fb82 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:54.967838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df5af-799d-4561-91bc-ac086571085b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:54.969408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd84d-5f57-42c3-b6df-5f88db8fc367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:54.970221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd84d-5f57-42c3-b6df-5f88db8fc367 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.970501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd84d-5f57-42c3-b6df-5f88db8fc367 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.970807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd84d-5f57-42c3-b6df-5f88db8fc367 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:54.981761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbd84d-5f57-42c3-b6df-5f88db8fc367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:54.990150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b4cbd84d-5f57-42c3-b6df-5f88db8fc367 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:52:54.991729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 146/282] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:54.992945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e743-1876-41ad-a1e5-94446f57dd76 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:54.993231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e743-1876-41ad-a1e5-94446f57dd76 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:54.994056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e743-1876-41ad-a1e5-94446f57dd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.014357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.015086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.015370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.015635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.017122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, user.id=12ca929cd0e746f3b3d22e0997f1428c, scope.system=all) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:55.017122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:55.018255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:55.024859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 137/283] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Mar 31 17:52:54 2022] GET /identity/v3/role_assignments?user.id=12ca929cd0e746f3b3d22e0997f1428c&scope.system=all&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:55.025619 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.140904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-23a7e743-1876-41ad-a1e5-94446f57dd76 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:55.142142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-23a7e743-1876-41ad-a1e5-94446f57dd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:55.174333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35a6b-349b-421a-857b-b661769072e8 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.214580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.215264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.216349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.216349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.216601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:55.216857 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:55.219514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:55.219651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 147/284] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:55.228228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 138/285] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:55.233819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e743-1876-41ad-a1e5-94446f57dd76 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.252415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.339834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e743-1876-41ad-a1e5-94446f57dd76 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.354299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3aabd4-e8e0-4954-ace0-f7f514fac85d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.375051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.375976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.376261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.376538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] PATH_INFO: `/v3/users/7e02fda0476f45e7a1269a996c59c0ea` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.377959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] RBAC: Authorizing `identity:get_user(user_id=7e02fda0476f45e7a1269a996c59c0ea)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:55.379250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:55.381105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 148/286] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:55 2022] GET /identity/v3/users/7e02fda0476f45e7a1269a996c59c0ea => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:55.386448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.392944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.394076 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.394534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.395188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.406113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:55.413553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:55.415320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 139/287] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:55.421862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.489019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f291-3c3e-4f1a-a5d3-2e714ef8b43f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.523710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.524568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.524849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.525123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.525425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa468-76b5-4965-b301-ba06b2cf6f7c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.526503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:55.527972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:55.530172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 149/288] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:55 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:55.535835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.562355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.563389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.563888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.564373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.565399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:55.565905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:55.567487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:55.576212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 140/289] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:55.584734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.682347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fef4ff-02bd-4cf4-9c8c-34caa84088b8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.689133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dbc95-1a70-4545-8d27-54073fb40840 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.729849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.730764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.731046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.731322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082/users/7e02fda0476f45e7a1269a996c59c0ea/roles/0e2c092f713b413abc3ac9e75947878c` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.735581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c7efcccade14922af9a4a4425790082, user_id=7e02fda0476f45e7a1269a996c59c0ea, role_id=0e2c092f713b413abc3ac9e75947878c)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:55.737504 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:55.745617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.746487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.746806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.747083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] PATH_INFO: `/v3/users/e08fde2c1f614140b432b9eaab0d1c99` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:55.748280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] RBAC: Authorizing `identity:get_user(user_id=e08fde2c1f614140b432b9eaab0d1c99)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:55.750345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:55.752368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 141/290] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:55 2022] GET /identity/v3/users/e08fde2c1f614140b432b9eaab0d1c99 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:55.757672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:55.803426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 150/291] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:52:55 2022] PUT /identity/v3/projects/2c7efcccade14922af9a4a4425790082/users/7e02fda0476f45e7a1269a996c59c0ea/roles/0e2c092f713b413abc3ac9e75947878c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:52:55.887884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dfc36-ed64-4860-9f85-578b14f525a2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:55.937949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:55.938638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:55.938976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:55.939255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:56.027332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:56.028722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:56.171172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 142/292] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:52:56.176736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:56.289041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa3a4-64eb-457a-abea-cb5f232ba7c5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:56.325790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2d8b2-b896-48aa-8c5f-f87ef5e43f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:56.326685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2d8b2-b896-48aa-8c5f-f87ef5e43f68 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:56.327539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2d8b2-b896-48aa-8c5f-f87ef5e43f68 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:56.327827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2d8b2-b896-48aa-8c5f-f87ef5e43f68 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:56.329034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2d8b2-b896-48aa-8c5f-f87ef5e43f68 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:56.330477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2d8b2-b896-48aa-8c5f-f87ef5e43f68 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:56.332620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 151/293] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:56 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:56.338455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:56.492748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531630bd-2cb8-42c3-a2a7-6b186049545b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:56.542218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba81a4-5914-4c9a-b941-f3f76f8cad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:56.543629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba81a4-5914-4c9a-b941-f3f76f8cad8a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:56.544047 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba81a4-5914-4c9a-b941-f3f76f8cad8a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:56.544458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba81a4-5914-4c9a-b941-f3f76f8cad8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:56.545441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba81a4-5914-4c9a-b941-f3f76f8cad8a None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=e08fde2c1f614140b432b9eaab0d1c99) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:56.546131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba81a4-5914-4c9a-b941-f3f76f8cad8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:56.547821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba81a4-5914-4c9a-b941-f3f76f8cad8a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:56.555062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 143/294] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:56 2022] GET /identity/v3/role_assignments?user.id=e08fde2c1f614140b432b9eaab0d1c99&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:57.624804 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d04f-4d73-4fcd-b301-83a01e08dbf1 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:57.625350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d04f-4d73-4fcd-b301-83a01e08dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:57.625350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d04f-4d73-4fcd-b301-83a01e08dbf1 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:57.627152 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 152/295] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:57.632593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88496107-3513-45d0-aef8-237cce1f7b3b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:57.633434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88496107-3513-45d0-aef8-237cce1f7b3b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:57.633908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88496107-3513-45d0-aef8-237cce1f7b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:57.651298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-88496107-3513-45d0-aef8-237cce1f7b3b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:57.652785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-88496107-3513-45d0-aef8-237cce1f7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:57.721072 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 144/296] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:57.744206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72d04f-4d73-4fcd-b301-83a01e08dbf1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:57.805475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497f94-8a51-48b8-9b39-0854c195a923 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:57.805475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497f94-8a51-48b8-9b39-0854c195a923 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:57.805475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497f94-8a51-48b8-9b39-0854c195a923 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:57.806180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 145/297] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:52:57.811217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95ad7-a7f3-4394-91a5-d5dc16c6a5d7 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:57.812394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95ad7-a7f3-4394-91a5-d5dc16c6a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:57.812888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95ad7-a7f3-4394-91a5-d5dc16c6a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:57.832987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0fd95ad7-a7f3-4394-91a5-d5dc16c6a5d7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:57.834161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0fd95ad7-a7f3-4394-91a5-d5dc16c6a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:57.848681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72d04f-4d73-4fcd-b301-83a01e08dbf1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:57.886555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:57.887364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:57.887650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:57.887926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:57.897714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:57.900315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 146/298] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:52:57.904782 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:52:57.906651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 153/299] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:57.911245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eeb03-d924-446c-a87f-e526a8b444b6 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:57.911616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eeb03-d924-446c-a87f-e526a8b444b6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:57.911975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eeb03-d924-446c-a87f-e526a8b444b6 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:57.912380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:57.914267 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 147/300] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:57.924206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d981-6e7b-4644-bacc-9f2434d1a0f9 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:57.924489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d981-6e7b-4644-bacc-9f2434d1a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:57.924766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d981-6e7b-4644-bacc-9f2434d1a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:57.941961 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-82d1d981-6e7b-4644-bacc-9f2434d1a0f9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:57.943180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-82d1d981-6e7b-4644-bacc-9f2434d1a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:58.012121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 148/301] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:58.013017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd56fe2-b39c-4404-a720-29350b739971 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.013502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1d981-6e7b-4644-bacc-9f2434d1a0f9 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.064485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.065362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.065471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.065723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.066484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:58.066827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.068205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.081207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 154/302] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:52:58.081207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.128740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1d981-6e7b-4644-bacc-9f2434d1a0f9 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.162694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.163453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.163737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.164015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.165149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.166582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.173436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 149/303] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:58.173436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.185342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521af41-36f6-403a-aa11-782d265ed85e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.221318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.222587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.222918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.223373 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.237951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:58.247201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:52:58.253669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 155/304] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:52:58.253669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.274233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcea295-921d-411d-b942-0004728670c4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.307403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.308277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.308559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.308834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] PATH_INFO: `/v3/users/12ca929cd0e746f3b3d22e0997f1428c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.310037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] RBAC: Authorizing `identity:get_user(user_id=12ca929cd0e746f3b3d22e0997f1428c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.312115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.313777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 150/305] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/users/12ca929cd0e746f3b3d22e0997f1428c => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:58.314534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.366626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d7246-a7e2-4c43-9eba-0b96ebf8b71d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.400928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.401598 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.401879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.402166 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] PATH_INFO: `/v3/groups` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.402880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.404311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.414458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944e37d-5f2b-4ee0-a1b9-84a5ab601aeb None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.446981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.447753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.448038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.448308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.449053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:58.449375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.450740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.458965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 151/306] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:58.460878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.490020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 156/307] 10.222.0.58 () {60 vars in 1134 bytes} [Thu Mar 31 17:52:58 2022] POST /identity/v3/groups => generated 229 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:52:58.490020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.601396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898588f3-f0fc-494f-abea-3a778e734f8a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.606235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ee4d8-7f2a-4dff-9f8d-d885511ba346 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.638084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.639006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.639289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.640101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] PATH_INFO: `/v3/system/users/12ca929cd0e746f3b3d22e0997f1428c/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.642167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=12ca929cd0e746f3b3d22e0997f1428c, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.643514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.648139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf2d4b-5f8d-46ba-91c6-de914ce0077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.648984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2d4b-5f8d-46ba-91c6-de914ce0077e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.649260 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2d4b-5f8d-46ba-91c6-de914ce0077e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.649534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2d4b-5f8d-46ba-91c6-de914ce0077e None admin] PATH_INFO: `/v3/users/3d460249d26448f181e5c049543b0917` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.664597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf2d4b-5f8d-46ba-91c6-de914ce0077e None admin] RBAC: Authorizing `identity:get_user(user_id=3d460249d26448f181e5c049543b0917)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.665972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf2d4b-5f8d-46ba-91c6-de914ce0077e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.675294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 157/308] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/users/3d460249d26448f181e5c049543b0917 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:58.675294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554452-01a3-4856-bf7e-72f0415df37b None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.675294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554452-01a3-4856-bf7e-72f0415df37b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.675294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554452-01a3-4856-bf7e-72f0415df37b None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.675294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 158/309] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:52:58.677051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72913903-2663-4ec4-aa90-83b0a9a12201 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.677570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72913903-2663-4ec4-aa90-83b0a9a12201 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.677857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72913903-2663-4ec4-aa90-83b0a9a12201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.694999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-72913903-2663-4ec4-aa90-83b0a9a12201 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:52:58.696170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-72913903-2663-4ec4-aa90-83b0a9a12201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:52:58.719024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 152/310] 10.222.0.58 () {58 vars in 1334 bytes} [Thu Mar 31 17:52:58 2022] PUT /identity/v3/system/users/12ca929cd0e746f3b3d22e0997f1428c/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:52:58.719763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.770320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 159/311] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:52:58.794061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72913903-2663-4ec4-aa90-83b0a9a12201 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:58.841033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7577f0-b61c-4b6f-af10-a43fedcde5f4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.878146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.879252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.879738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.880210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.881275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] RBAC: Adding query filter params (role.id=0e2c092f713b413abc3ac9e75947878c, user.id=3d460249d26448f181e5c049543b0917, scope.system=all) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:58.881787 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:58.883531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:58.889542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 153/312] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/role_assignments?user.id=3d460249d26448f181e5c049543b0917&scope.system=all&role.id=0e2c092f713b413abc3ac9e75947878c => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:58.901413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72913903-2663-4ec4-aa90-83b0a9a12201 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:58.945242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:58.945971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:58.946246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:58.946513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:58.959970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:52:58.967226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:52:58.969447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 160/313] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:52:58.975507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:59.095717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc1ab5-7f53-4952-99c6-a832084e16ac None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:59.130177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:59.131930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:59.131930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:59.131930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:59.132289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:59.132510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:59.133885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:59.142639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 154/314] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:52:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:59.148102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:59.254662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f1aee-f8a5-4e35-ab11-2b793889dccb None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:59.287787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:59.288660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:59.288936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:59.289209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] PATH_INFO: `/v3/users/7e02fda0476f45e7a1269a996c59c0ea` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:59.290409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] RBAC: Authorizing `identity:get_user(user_id=7e02fda0476f45e7a1269a996c59c0ea)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:59.291883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:59.293817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 161/315] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:52:59 2022] GET /identity/v3/users/7e02fda0476f45e7a1269a996c59c0ea => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:59.299591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:59.398690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303762-9369-4ec2-8550-0ac415ce085f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:59.431806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:59.432459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:59.432742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:59.433016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:59.500529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:59.501985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:59.602384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 155/316] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:52:59.607762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:59.717413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93fa5-6094-405e-bcf7-d57c3a176e0f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:59.752875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37bebe-ced4-41a1-90c9-82920d282831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:59.754036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37bebe-ced4-41a1-90c9-82920d282831 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:59.754516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37bebe-ced4-41a1-90c9-82920d282831 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:59.754985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37bebe-ced4-41a1-90c9-82920d282831 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:59.756343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37bebe-ced4-41a1-90c9-82920d282831 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:59.757945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37bebe-ced4-41a1-90c9-82920d282831 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:59.760125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 162/317] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:52:59 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:52:59.766128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:52:59.865761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308d5b-5642-4ac6-b118-fc5f37d66d03 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:52:59.899072 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7c7c6-86df-48ad-9612-fc8f5483541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:52:59.899733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c7c6-86df-48ad-9612-fc8f5483541e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:52:59.900012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c7c6-86df-48ad-9612-fc8f5483541e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:52:59.900285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c7c6-86df-48ad-9612-fc8f5483541e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:52:59.901118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7c7c6-86df-48ad-9612-fc8f5483541e None admin] RBAC: Adding query filter params (role.id=0e2c092f713b413abc3ac9e75947878c, scope.project.id=2c7efcccade14922af9a4a4425790082, user.id=7e02fda0476f45e7a1269a996c59c0ea) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:52:59.901423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7c7c6-86df-48ad-9612-fc8f5483541e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:52:59.902871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7c7c6-86df-48ad-9612-fc8f5483541e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:52:59.909063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 156/318] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:52:59 2022] GET /identity/v3/role_assignments?user.id=7e02fda0476f45e7a1269a996c59c0ea&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=0e2c092f713b413abc3ac9e75947878c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:00.868236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dc81d-f78c-4550-a56c-12c37ecab830 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:00.868863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dc81d-f78c-4550-a56c-12c37ecab830 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:00.868863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dc81d-f78c-4550-a56c-12c37ecab830 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:00.870602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 163/319] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:00.876719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928ad9-1f91-43d7-89b2-eee2b132dfec None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:00.877199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928ad9-1f91-43d7-89b2-eee2b132dfec None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:00.877284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928ad9-1f91-43d7-89b2-eee2b132dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:00.893901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-01928ad9-1f91-43d7-89b2-eee2b132dfec None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:00.895135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-01928ad9-1f91-43d7-89b2-eee2b132dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:00.958734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 157/320] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:00.981063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dc81d-f78c-4550-a56c-12c37ecab830 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.085664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dc81d-f78c-4550-a56c-12c37ecab830 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.119000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8545a-3128-4994-aec0-7daf023b2178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.119719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8545a-3128-4994-aec0-7daf023b2178 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.120001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8545a-3128-4994-aec0-7daf023b2178 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.120272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8545a-3128-4994-aec0-7daf023b2178 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.121509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8545a-3128-4994-aec0-7daf023b2178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:01.122850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02b15-5929-4b2f-a202-09d91475f61f None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.122968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8545a-3128-4994-aec0-7daf023b2178 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:01.123141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02b15-5929-4b2f-a202-09d91475f61f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.123416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02b15-5929-4b2f-a202-09d91475f61f None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.129771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 164/321] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:01.129921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 158/322] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:01.130325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02b15-5929-4b2f-a202-09d91475f61f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.130847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddccf-cb0a-4577-bd36-6845a22eca30 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.131138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddccf-cb0a-4577-bd36-6845a22eca30 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.131410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddccf-cb0a-4577-bd36-6845a22eca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.148306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-950ddccf-cb0a-4577-bd36-6845a22eca30 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:01.149484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-950ddccf-cb0a-4577-bd36-6845a22eca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:01.216058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 165/323] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:01.217355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daf16b-def0-4675-8bae-3367ff51ac73 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.217641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daf16b-def0-4675-8bae-3367ff51ac73 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.217970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daf16b-def0-4675-8bae-3367ff51ac73 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.219917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 166/324] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:01.224763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59fc2-dad0-4691-9491-bd2264538177 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.225049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59fc2-dad0-4691-9491-bd2264538177 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.225327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59fc2-dad0-4691-9491-bd2264538177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.236872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02b15-5929-4b2f-a202-09d91475f61f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.241791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-99d59fc2-dad0-4691-9491-bd2264538177 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:01.243004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-99d59fc2-dad0-4691-9491-bd2264538177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:01.271182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.271853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.272138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.272417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] PATH_INFO: `/v3/groups` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.273108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:01.274545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:01.306144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 167/325] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:01.306986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d59fc2-dad0-4691-9491-bd2264538177 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.384595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 159/326] 10.222.0.58 () {60 vars in 1134 bytes} [Thu Mar 31 17:53:01 2022] POST /identity/v3/groups => generated 226 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:01.385382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.404646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d59fc2-dad0-4691-9491-bd2264538177 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.442819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.443751 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.444038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.444309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.456869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:01.464037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:53:01.465543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 168/327] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:01.472503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.496943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1f00f-eaf3-45e6-8a70-0751fa9febb8 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.533474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.534284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.534565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.534863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.545595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:01.552986 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:53:01.554410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 160/328] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:01.560071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.576659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ecc96-0502-41f1-bdce-e3f214a7067e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.614477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.615191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.615468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.615739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.616483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:01.616901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:01.618480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:01.628154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 169/329] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:01.633672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.662594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1e44-32a5-44f3-8bd1-f316637fc0a1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.698135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.698846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.699133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.699467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.700305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:01.700583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:01.701972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:01.711235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 161/330] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:01.717159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.752058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a26d-d0d3-4521-86ba-8f23ba420fe0 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.788612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.789490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.789772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.790049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] PATH_INFO: `/v3/users/12ca929cd0e746f3b3d22e0997f1428c` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.791291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] RBAC: Authorizing `identity:get_user(user_id=12ca929cd0e746f3b3d22e0997f1428c)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:01.792740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:01.798729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 170/331] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:53:01 2022] GET /identity/v3/users/12ca929cd0e746f3b3d22e0997f1428c => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:01.801091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.829053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e365bc-c135-400d-8234-5ac8adc9cfcb None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.867219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.868157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.868441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.868715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] PATH_INFO: `/v3/users/3d460249d26448f181e5c049543b0917` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.869973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] RBAC: Authorizing `identity:get_user(user_id=3d460249d26448f181e5c049543b0917)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:01.871463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:01.873170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 162/332] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:53:01 2022] GET /identity/v3/users/3d460249d26448f181e5c049543b0917 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:01.881460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:01.909466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f365c-630e-4b84-a773-fe186e6409e5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:01.948246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ef51d-a874-4eda-bf3c-e4fb33e35b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:01.948904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ef51d-a874-4eda-bf3c-e4fb33e35b0a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:01.949185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ef51d-a874-4eda-bf3c-e4fb33e35b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:01.949512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ef51d-a874-4eda-bf3c-e4fb33e35b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:01.950376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ef51d-a874-4eda-bf3c-e4fb33e35b0a None admin] RBAC: Adding query filter params (role.id=7e3d435fdd2047a4bf96a5fc9661c311, user.id=12ca929cd0e746f3b3d22e0997f1428c, scope.system=all) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:01.950719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ef51d-a874-4eda-bf3c-e4fb33e35b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:01.952370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ef51d-a874-4eda-bf3c-e4fb33e35b0a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:01.966007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 171/333] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Mar 31 17:53:01 2022] GET /identity/v3/role_assignments?user.id=12ca929cd0e746f3b3d22e0997f1428c&scope.system=all&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:02.120322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a89b76-ab93-4fed-a4c3-f326c4841c2f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:02.158206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b99b-8416-4427-a369-7ea37e44c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:02.159116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b99b-8416-4427-a369-7ea37e44c602 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:02.159401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b99b-8416-4427-a369-7ea37e44c602 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:02.159678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b99b-8416-4427-a369-7ea37e44c602 None admin] PATH_INFO: `/v3/system/users/3d460249d26448f181e5c049543b0917/roles/0e2c092f713b413abc3ac9e75947878c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:02.161269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b99b-8416-4427-a369-7ea37e44c602 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d460249d26448f181e5c049543b0917, role_id=0e2c092f713b413abc3ac9e75947878c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:02.162686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b99b-8416-4427-a369-7ea37e44c602 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:02.243763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 163/334] 10.222.0.58 () {58 vars in 1334 bytes} [Thu Mar 31 17:53:01 2022] PUT /identity/v3/system/users/3d460249d26448f181e5c049543b0917/roles/0e2c092f713b413abc3ac9e75947878c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:53:04.297702 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f457-d990-45bc-a58b-c875618c1e70 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:04.298210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f457-d990-45bc-a58b-c875618c1e70 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:04.298314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f457-d990-45bc-a58b-c875618c1e70 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:04.300231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 172/335] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:04.305455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d143b7-ee79-48a2-b62d-47a7d76d4096 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:04.306279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d143b7-ee79-48a2-b62d-47a7d76d4096 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:04.306788 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d143b7-ee79-48a2-b62d-47a7d76d4096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:04.328588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-41d143b7-ee79-48a2-b62d-47a7d76d4096 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:04.330101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-41d143b7-ee79-48a2-b62d-47a7d76d4096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:04.419519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 164/336] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:04.443892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189f457-d990-45bc-a58b-c875618c1e70 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:04.584525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189f457-d990-45bc-a58b-c875618c1e70 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:04.627425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533540-86c7-4487-b57d-5f299e05d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:04.628229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533540-86c7-4487-b57d-5f299e05d28a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:04.628507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533540-86c7-4487-b57d-5f299e05d28a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:04.628781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533540-86c7-4487-b57d-5f299e05d28a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:04.645316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a533540-86c7-4487-b57d-5f299e05d28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:04.652466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-0a533540-86c7-4487-b57d-5f299e05d28a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:53:04.653682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 173/337] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:04.660232 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d143b7-ee79-48a2-b62d-47a7d76d4096 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:04.791131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d143b7-ee79-48a2-b62d-47a7d76d4096 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:04.831116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97be84-3074-4bee-94b9-0d9d5fe98aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:04.831800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97be84-3074-4bee-94b9-0d9d5fe98aa4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:04.832082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97be84-3074-4bee-94b9-0d9d5fe98aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:04.832355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97be84-3074-4bee-94b9-0d9d5fe98aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:04.833106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97be84-3074-4bee-94b9-0d9d5fe98aa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:04.833412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97be84-3074-4bee-94b9-0d9d5fe98aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:04.834950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97be84-3074-4bee-94b9-0d9d5fe98aa4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:04.840180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e33633-3126-4748-8ddb-53de858b031d None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:04.840464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e33633-3126-4748-8ddb-53de858b031d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:04.840738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e33633-3126-4748-8ddb-53de858b031d None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:04.842494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 174/338] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:04.844315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 165/339] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:04.849379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e33633-3126-4748-8ddb-53de858b031d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:04.855005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a9b42-1233-43c1-8940-87b704e07eab None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:04.855298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a9b42-1233-43c1-8940-87b704e07eab None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:04.855582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a9b42-1233-43c1-8940-87b704e07eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:04.876002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6d2a9b42-1233-43c1-8940-87b704e07eab None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:04.877175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6d2a9b42-1233-43c1-8940-87b704e07eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:05.005254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 166/340] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:05.019885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e33633-3126-4748-8ddb-53de858b031d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:05.066009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6d292-0d6c-4242-a944-782b5e99d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:05.067050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6d292-0d6c-4242-a944-782b5e99d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.067718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6d292-0d6c-4242-a944-782b5e99d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.068202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6d292-0d6c-4242-a944-782b5e99d9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.070515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a9b42-1233-43c1-8940-87b704e07eab None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:05.230655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a9b42-1233-43c1-8940-87b704e07eab None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:05.240343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6d292-0d6c-4242-a944-782b5e99d9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:05.241845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6d292-0d6c-4242-a944-782b5e99d9d3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:05.271740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f95fc-185d-46a5-8004-d6e8a6aef219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:05.272558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f95fc-185d-46a5-8004-d6e8a6aef219 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.272837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f95fc-185d-46a5-8004-d6e8a6aef219 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.273106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f95fc-185d-46a5-8004-d6e8a6aef219 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.296969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f95fc-185d-46a5-8004-d6e8a6aef219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:05.304524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-a70f95fc-185d-46a5-8004-d6e8a6aef219 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:53:05.305789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 167/341] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:05.321842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073594-8f4b-4b4f-9c2d-d171f79efc2e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.322178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073594-8f4b-4b4f-9c2d-d171f79efc2e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.322402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073594-8f4b-4b4f-9c2d-d171f79efc2e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.324280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 168/342] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:05 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:05.329621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69073594-8f4b-4b4f-9c2d-d171f79efc2e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:05.388783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 175/343] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:05.391609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039df47a-ec38-4182-aa4b-86bf1b83a143 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.392028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039df47a-ec38-4182-aa4b-86bf1b83a143 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.392447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039df47a-ec38-4182-aa4b-86bf1b83a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.410456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-039df47a-ec38-4182-aa4b-86bf1b83a143 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:05.411889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-039df47a-ec38-4182-aa4b-86bf1b83a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:05.480297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 176/344] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:05.481484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039df47a-ec38-4182-aa4b-86bf1b83a143 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:05.489596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69073594-8f4b-4b4f-9c2d-d171f79efc2e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:05.539320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:05.540183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.540561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.540935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.541789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:05.542185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:05.543793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:05.553078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 169/345] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:05.557707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:05.584420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039df47a-ec38-4182-aa4b-86bf1b83a143 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:05.619122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:05.620233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.620677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.621103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.622453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:05.624799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:05.626873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 177/346] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:05.627947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:05.699282 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436699eb-2f52-47b2-bf4d-2e350cf1925c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:05.728526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd4af-ee91-4c0b-a1a7-e012d27db514 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:05.737615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:05.738987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.739470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.739940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.754202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:05.762903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:53:05.764689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 170/347] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:05.765643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:05.766450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.766757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.766870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:05.767024 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.836859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:05.838537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:05.871507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4e31c-7a24-45fe-b599-3ce87af57ef1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:05.906545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:05.907973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:05.908453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:05.908935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:05.916555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:05.918286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:05.920234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 171/348] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:05.922127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:05.941911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 178/349] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:05.943148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.025737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b67eb6-d14c-404a-98a6-d61c7b03355b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.044165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a9c6-cf02-4fe9-9244-56c8e91e7bdc None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.073451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.074461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.074976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.075477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.076421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:06.076946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:06.079985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:06.082446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64303b1-1bf0-4222-8811-8ece47b810b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.083545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64303b1-1bf0-4222-8811-8ece47b810b7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.084020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64303b1-1bf0-4222-8811-8ece47b810b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.084467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64303b1-1bf0-4222-8811-8ece47b810b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.085485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64303b1-1bf0-4222-8811-8ece47b810b7 None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=16004a326feb4230b6b46f54063e1069) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:06.085969 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64303b1-1bf0-4222-8811-8ece47b810b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:06.087612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64303b1-1bf0-4222-8811-8ece47b810b7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:06.089753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 172/350] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:06.091807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.094866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 179/351] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:05 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:06.096534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec34f-08b8-4d10-8a97-f89e56e018f4 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.096534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec34f-08b8-4d10-8a97-f89e56e018f4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.096865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dec34f-08b8-4d10-8a97-f89e56e018f4 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.098650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 180/352] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:06.099262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dec34f-08b8-4d10-8a97-f89e56e018f4 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.209933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dec2-7c0a-40da-8980-27fea98027c3 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.223757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dec34f-08b8-4d10-8a97-f89e56e018f4 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.248848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf03e3f-b5ba-47f9-8fe0-7bc01f14abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.251071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf03e3f-b5ba-47f9-8fe0-7bc01f14abe1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.251563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf03e3f-b5ba-47f9-8fe0-7bc01f14abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.252029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf03e3f-b5ba-47f9-8fe0-7bc01f14abe1 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.253691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf03e3f-b5ba-47f9-8fe0-7bc01f14abe1 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:06.255418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf03e3f-b5ba-47f9-8fe0-7bc01f14abe1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:06.257824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 173/353] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:06.259611 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ec06a-e8a0-48c7-911d-961b2e57c81b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.260193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ec06a-e8a0-48c7-911d-961b2e57c81b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.260722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ec06a-e8a0-48c7-911d-961b2e57c81b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.262984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d78271-cc4e-48a4-97ee-24d04a6d6c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.263270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 174/354] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:06.264023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78271-cc4e-48a4-97ee-24d04a6d6c5c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.264485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78271-cc4e-48a4-97ee-24d04a6d6c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.264839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3f39-12a4-4f42-b1d7-e471134abe13 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.265143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78271-cc4e-48a4-97ee-24d04a6d6c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.265383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3f39-12a4-4f42-b1d7-e471134abe13 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.265795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3f39-12a4-4f42-b1d7-e471134abe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.285475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-cb8c3f39-12a4-4f42-b1d7-e471134abe13 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:06.286839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cb8c3f39-12a4-4f42-b1d7-e471134abe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:06.337798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d78271-cc4e-48a4-97ee-24d04a6d6c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:06.339529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d78271-cc4e-48a4-97ee-24d04a6d6c5c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:06.361215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 175/355] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:06.362745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c3f39-12a4-4f42-b1d7-e471134abe13 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.447168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 181/356] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:06.449183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9103a-397f-4f6f-aef2-fe2f31d167d5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.449608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9103a-397f-4f6f-aef2-fe2f31d167d5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.450020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9103a-397f-4f6f-aef2-fe2f31d167d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.467752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-95d9103a-397f-4f6f-aef2-fe2f31d167d5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:06.469971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-95d9103a-397f-4f6f-aef2-fe2f31d167d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:06.487707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c3f39-12a4-4f42-b1d7-e471134abe13 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.524317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.525520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.526003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.526492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.527983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:06.529662 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:06.532960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 176/357] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:06.534090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.545116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 182/358] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:06.545285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9103a-397f-4f6f-aef2-fe2f31d167d5 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.659032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a160-5029-4b2b-a666-f1929c20651a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.664479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9103a-397f-4f6f-aef2-fe2f31d167d5 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.700659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.701912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.703131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.703884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.711984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520e803-1fee-4371-87ff-309cc4c2864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.712872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e803-1fee-4371-87ff-309cc4c2864a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.713149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e803-1fee-4371-87ff-309cc4c2864a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.713419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e803-1fee-4371-87ff-309cc4c2864a None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.714675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520e803-1fee-4371-87ff-309cc4c2864a None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:06.716110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520e803-1fee-4371-87ff-309cc4c2864a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:06.718046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:06.718193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 183/359] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:06.720218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433385-5aaa-47ef-ae5b-b037b981ebb2 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.720684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433385-5aaa-47ef-ae5b-b037b981ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.721116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433385-5aaa-47ef-ae5b-b037b981ebb2 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.723305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 184/360] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:06.724333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433385-5aaa-47ef-ae5b-b037b981ebb2 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.733304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:53:06.738531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 177/361] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:06.739692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.860204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433385-5aaa-47ef-ae5b-b037b981ebb2 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.870193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cadcc-3e09-45ed-b955-b564ef9cfe5a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:06.908505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.908505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.908902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.909069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.909967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=16004a326feb4230b6b46f54063e1069) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:06.910276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:06.912307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:06.918536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 185/362] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:06.918748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f9a1-a5de-4731-ace6-503c9fb42f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:06.919549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f9a1-a5de-4731-ace6-503c9fb42f7f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.919781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:06.919881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f9a1-a5de-4731-ace6-503c9fb42f7f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.920104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f9a1-a5de-4731-ace6-503c9fb42f7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.935802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167f9a1-a5de-4731-ace6-503c9fb42f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:06.945621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-5167f9a1-a5de-4731-ace6-503c9fb42f7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 31 17:53:06.947537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 178/363] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:06.949487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddf1f1-f80e-456b-87cb-c3a1ed70f4a7 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:06.950053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddf1f1-f80e-456b-87cb-c3a1ed70f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:06.950337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddf1f1-f80e-456b-87cb-c3a1ed70f4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:06.977597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e3ddf1f1-f80e-456b-87cb-c3a1ed70f4a7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:06.978853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e3ddf1f1-f80e-456b-87cb-c3a1ed70f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:07.040255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be814933-5cac-4c23-a8a6-818595606d56 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.067233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 179/364] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:07.067233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddf1f1-f80e-456b-87cb-c3a1ed70f4a7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.086333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.087810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.088096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.088375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.089683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.091685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:07.094386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 186/365] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:06 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:07.095590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.190882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddf1f1-f80e-456b-87cb-c3a1ed70f4a7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.239866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.240411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e6d74-cca7-4f84-92f1-fe8719b7d981 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.241114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.241586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.242185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.244060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:07.244575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.246148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:07.259940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 180/366] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:07.259940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.294240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.295335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.295814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.296451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.297400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] RBAC: Adding query filter params (name=reader) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:07.297927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.299509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:07.308666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 187/367] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:07.309745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.387984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8dacb-6621-4b42-b955-955473792c37 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.429616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.430689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.431169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.431637 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.432750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=2c7efcccade14922af9a4a4425790082) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:07.433340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.435063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:07.443322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 181/368] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:07.444420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.446069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e169a8e-f665-4e45-b428-8ecdc578daea None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.485635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.487675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.488164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.488658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.502585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:07.510933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:07.513076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 188/369] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:07.514314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.633788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306df67a-6fce-42c2-893e-2f04b6f80cfc None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.674831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.676116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.676602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.677107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] PATH_INFO: `/v3/users/3d460249d26448f181e5c049543b0917` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.678583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] RBAC: Authorizing `identity:get_user(user_id=3d460249d26448f181e5c049543b0917)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.680502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:07.680964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e31de9-ee90-4e76-8b25-09336c39b457 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.683182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 189/370] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/users/3d460249d26448f181e5c049543b0917 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:07.684285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.772697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.773371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.773652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.773932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.806879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97f3cf-7a8e-4155-87d8-675077d1e74e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.841821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.842506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.842813 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.843117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.844651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:07.844964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.846337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:07.854861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 190/371] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:07.855673 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:07.943721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.945202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:07.957917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0628b3-a872-44ea-a450-7338ce1178ed None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:07.992217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:07.992883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:07.993191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:07.993445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:07.994271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] RBAC: Adding query filter params (role.id=0e2c092f713b413abc3ac9e75947878c, user.id=3d460249d26448f181e5c049543b0917, scope.system=all) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:07.994582 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:07.996029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:08.008404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 191/372] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/role_assignments?user.id=3d460249d26448f181e5c049543b0917&scope.system=all&role.id=0e2c092f713b413abc3ac9e75947878c => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:08.009233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:08.159251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226581fb-1998-4934-988a-ff5067a982ad None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:08.206721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:08.207815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:08.208337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:08.208872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:08.215602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 182/373] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:08.221856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:08.309114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:08.310973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:08.503156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 192/374] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:08.507343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:08.540857 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b360073-ddb5-47ce-baae-ce52cb27b931 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:08.617265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709e1b-25c1-4a8f-989a-2c5c0423cba0 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:08.659606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:08.660739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:08.661231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:08.661635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] PATH_INFO: `/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:08.662998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] RBAC: Authorizing `identity:get_project(project_id=742ba5e3bf724a7681af774ed2a8d3b2)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:08.664582 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:08.668932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 193/375] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:08 2022] GET /identity/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:08.674575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:08.703836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:08.704975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:08.705429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:08.705862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:08.711389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:08.713000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:08.714906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 183/376] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:08 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:08.721073 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:08.831665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f16710-bcb4-42e2-9f7d-7b52855463b4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:08.922786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:08.925316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:08.927536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:08.928625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] PATH_INFO: `/v3/groups/e4d4fbb1afb04128bfcd84bfc91abf5b` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:08.947024 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] RBAC: Authorizing `identity:get_group(group_id=e4d4fbb1afb04128bfcd84bfc91abf5b)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:08.950191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:08.961100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 194/377] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:08 2022] GET /identity/v3/groups/e4d4fbb1afb04128bfcd84bfc91abf5b => generated 229 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:08.971634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:08.975757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee4ba6-ec12-402a-9465-9c262480ca6d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:09.035984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:09.037117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.037540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.037953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.039349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:09.040928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:09.043011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 184/378] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:08 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:09.048546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:09.151252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bd6d-f58e-406e-a8a0-91f7b8c9e4d4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:09.188740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9fbde-9af8-462f-ac3a-6ffc740d262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:09.189409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9fbde-9af8-462f-ac3a-6ffc740d262c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.189692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9fbde-9af8-462f-ac3a-6ffc740d262c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.189972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9fbde-9af8-462f-ac3a-6ffc740d262c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.190830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9fbde-9af8-462f-ac3a-6ffc740d262c None admin] RBAC: Adding query filter params (group.id=e4d4fbb1afb04128bfcd84bfc91abf5b, role.id=641f3a975368436eac3de51f3605c569, scope.project.id=742ba5e3bf724a7681af774ed2a8d3b2) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:09.191141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9fbde-9af8-462f-ac3a-6ffc740d262c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:09.192633 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9fbde-9af8-462f-ac3a-6ffc740d262c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:09.207117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 195/379] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:08 2022] GET /identity/v3/role_assignments?group.id=e4d4fbb1afb04128bfcd84bfc91abf5b&scope.project.id=742ba5e3bf724a7681af774ed2a8d3b2&role.id=641f3a975368436eac3de51f3605c569 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:09.222472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c815f1-1d0a-46be-9a33-8c0893be7864 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:09.261408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b6e9e-324b-4405-99a9-1477dc63b24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:09.262130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6e9e-324b-4405-99a9-1477dc63b24c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.262363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6e9e-324b-4405-99a9-1477dc63b24c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.262658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6e9e-324b-4405-99a9-1477dc63b24c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.263513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b6e9e-324b-4405-99a9-1477dc63b24c None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=2c7efcccade14922af9a4a4425790082) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:09.263822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b6e9e-324b-4405-99a9-1477dc63b24c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:09.265847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b6e9e-324b-4405-99a9-1477dc63b24c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:09.272022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 185/380] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:09 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:09.555848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a1ae-3755-4f11-a8f0-504be8eeda20 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.556807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a1ae-3755-4f11-a8f0-504be8eeda20 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.557324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a1ae-3755-4f11-a8f0-504be8eeda20 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.559632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 196/381] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:09.566026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d760-a26a-41be-955c-d8728b97b265 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.566915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d760-a26a-41be-955c-d8728b97b265 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.567421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d760-a26a-41be-955c-d8728b97b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.585825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ee11d760-a26a-41be-955c-d8728b97b265 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:09.587327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ee11d760-a26a-41be-955c-d8728b97b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:09.678360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 186/382] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:09.702136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28a1ae-3755-4f11-a8f0-504be8eeda20 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:09.824237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28a1ae-3755-4f11-a8f0-504be8eeda20 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:09.853508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648854-d9b0-4d49-83ae-5a45e5a9a1ce None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.853812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648854-d9b0-4d49-83ae-5a45e5a9a1ce None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.854048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648854-d9b0-4d49-83ae-5a45e5a9a1ce None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.855839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 187/383] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:09.868317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d9e8f-eb30-4c80-9a2a-0bd4c12534ca None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.868618 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d9e8f-eb30-4c80-9a2a-0bd4c12534ca None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.868858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d9e8f-eb30-4c80-9a2a-0bd4c12534ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.888243 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-638d9e8f-eb30-4c80-9a2a-0bd4c12534ca None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:09.889410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-638d9e8f-eb30-4c80-9a2a-0bd4c12534ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:09.893748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:09.894547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:09.897120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:09.897403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:09.914275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:09.923297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:53:09.924728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 197/384] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:09.933174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.024734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 188/385] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:10.064213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d9e8f-eb30-4c80-9a2a-0bd4c12534ca None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.120895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88afda-ad09-4a99-95bc-c112b5ff4768 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.182907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.183577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.183886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.184125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.184871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:10.185172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:10.186519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:10.196661 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 198/386] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:10.203868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.225062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d9e8f-eb30-4c80-9a2a-0bd4c12534ca None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.264647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.265496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.265772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.266132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.299258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:10.306676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:53:10.307904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 189/387] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:10.314437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.348343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183d6e-11b4-4559-a33a-5ce9d94fff4c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.389557 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.390933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.391205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.394920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.397074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:10.400603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:10.402264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 199/388] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:10.409035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.507342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab7823-4b6c-4ebc-a3a8-1b08a5fc7a4f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.530253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124553-36ae-497c-bde7-59521aaa44d0 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.550901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7714fd-e69d-4609-bc14-6ca07e8d9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.551928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7714fd-e69d-4609-bc14-6ca07e8d9837 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.552419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7714fd-e69d-4609-bc14-6ca07e8d9837 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.552899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7714fd-e69d-4609-bc14-6ca07e8d9837 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.553854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7714fd-e69d-4609-bc14-6ca07e8d9837 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:10.554389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7714fd-e69d-4609-bc14-6ca07e8d9837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:10.555981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7714fd-e69d-4609-bc14-6ca07e8d9837 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:10.567819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 190/389] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:10.569837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a23397-321d-409c-8a90-e6a38be9689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.570273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2acac-88ba-4640-a9d4-721ee94f149b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.570484 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2acac-88ba-4640-a9d4-721ee94f149b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.570895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2acac-88ba-4640-a9d4-721ee94f149b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.571623 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23397-321d-409c-8a90-e6a38be9689b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.572055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23397-321d-409c-8a90-e6a38be9689b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.572471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23397-321d-409c-8a90-e6a38be9689b None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.573040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 191/390] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:10.573978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a23397-321d-409c-8a90-e6a38be9689b None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:10.575621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a23397-321d-409c-8a90-e6a38be9689b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:10.577222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2acac-88ba-4640-a9d4-721ee94f149b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.578565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 200/391] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:10.579913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fc33-ac55-43db-b7b0-70bd6d50db48 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.580345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fc33-ac55-43db-b7b0-70bd6d50db48 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.580763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fc33-ac55-43db-b7b0-70bd6d50db48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.606413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8761fc33-ac55-43db-b7b0-70bd6d50db48 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:10.608543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8761fc33-ac55-43db-b7b0-70bd6d50db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:10.696767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 201/392] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:10.697891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761fc33-ac55-43db-b7b0-70bd6d50db48 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.708399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2acac-88ba-4640-a9d4-721ee94f149b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.745618 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.746816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.747224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.747591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.748900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:10.750792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:10.757134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 192/393] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:10.758224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.825292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761fc33-ac55-43db-b7b0-70bd6d50db48 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.868859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.870027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.870454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.870985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069/groups/454a920d4d8940a1879c5181a019f8e9/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.873538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] RBAC: Authorizing `identity:create_grant(project_id=16004a326feb4230b6b46f54063e1069, group_id=454a920d4d8940a1879c5181a019f8e9, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:10.876285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:10.889953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7749-4d44-46e3-b8d7-813aa7fd6050 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:10.929007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:10.929818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:10.930100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:10.930373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:10.942317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:10.949535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:53:10.950706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 193/394] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:10.951475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:10.975354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 202/395] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Mar 31 17:53:10 2022] PUT /identity/v3/projects/16004a326feb4230b6b46f54063e1069/groups/454a920d4d8940a1879c5181a019f8e9/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:10.977732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:11.085132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251902f-049b-4816-8ec2-182d56e9f88f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:11.142903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:11.145025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:11.145307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:11.145581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:11.147671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:11.149384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:11.151576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 194/396] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:11.158878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:11.163342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8ec1-5161-447b-84fc-280d5818d71e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:11.211354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:11.211956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:11.212232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:11.212508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:11.213259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:11.213559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:11.214951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:11.238061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 203/397] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:11.245084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:11.330520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e6979-1bfc-4d84-bb18-a198fcbb1dc2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:11.371533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b0531-e49c-4d98-ae0d-6c17feaebe1b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:11.380657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:11.381896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:11.382374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:11.382964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069/groups/454a920d4d8940a1879c5181a019f8e9/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:11.391212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] RBAC: Authorizing `identity:create_grant(project_id=16004a326feb4230b6b46f54063e1069, group_id=454a920d4d8940a1879c5181a019f8e9, role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:11.393759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:11.413153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:11.414073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:11.414362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:11.414655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:11.415915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:11.417409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:11.419490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 204/398] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:11 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:11.425154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:11.486816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 195/399] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Mar 31 17:53:11 2022] PUT /identity/v3/projects/16004a326feb4230b6b46f54063e1069/groups/454a920d4d8940a1879c5181a019f8e9/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:53:11.550909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670436a-34d0-496d-a622-9cfa99255e93 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:11.592971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad40e7-c417-4a87-a6e4-cc2a54d7a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:11.594695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad40e7-c417-4a87-a6e4-cc2a54d7a69a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:11.595051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad40e7-c417-4a87-a6e4-cc2a54d7a69a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:11.595374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad40e7-c417-4a87-a6e4-cc2a54d7a69a None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:11.598217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad40e7-c417-4a87-a6e4-cc2a54d7a69a None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:11.599711 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad40e7-c417-4a87-a6e4-cc2a54d7a69a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:11.601994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 205/400] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:11 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:11.607924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:11.729687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4ba3-f000-4fa8-907d-902c47b8e039 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:11.775027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca53943-a259-45fc-a61c-c1022e2d3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:11.775898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53943-a259-45fc-a61c-c1022e2d3c6f None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:11.776238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53943-a259-45fc-a61c-c1022e2d3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:11.776520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53943-a259-45fc-a61c-c1022e2d3c6f None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082/groups/454a920d4d8940a1879c5181a019f8e9/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:11.778488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca53943-a259-45fc-a61c-c1022e2d3c6f None admin] RBAC: Authorizing `identity:create_grant(project_id=2c7efcccade14922af9a4a4425790082, group_id=454a920d4d8940a1879c5181a019f8e9, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:11.780013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca53943-a259-45fc-a61c-c1022e2d3c6f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:11.884860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 196/401] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Mar 31 17:53:11 2022] PUT /identity/v3/projects/2c7efcccade14922af9a4a4425790082/groups/454a920d4d8940a1879c5181a019f8e9/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:12.204784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22453b-719b-4948-9c5c-c8c6c77b6b71 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.205143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22453b-719b-4948-9c5c-c8c6c77b6b71 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.205350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22453b-719b-4948-9c5c-c8c6c77b6b71 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.207491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 206/402] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:12.212836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72f93-8ff0-4bbf-b9ee-1261cc96ff11 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.213131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72f93-8ff0-4bbf-b9ee-1261cc96ff11 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.213413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72f93-8ff0-4bbf-b9ee-1261cc96ff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.228284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec75fa-89eb-4e45-bb17-49dbf823a572 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.228284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec75fa-89eb-4e45-bb17-49dbf823a572 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.228526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec75fa-89eb-4e45-bb17-49dbf823a572 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.230463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 207/403] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:12.233211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1df72f93-8ff0-4bbf-b9ee-1261cc96ff11 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:12.234704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1df72f93-8ff0-4bbf-b9ee-1261cc96ff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:12.235791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5ee2d-f279-496d-8d50-565c3b5d2727 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.236175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5ee2d-f279-496d-8d50-565c3b5d2727 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.236550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5ee2d-f279-496d-8d50-565c3b5d2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.256248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2ba5ee2d-f279-496d-8d50-565c3b5d2727 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:12.257977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2ba5ee2d-f279-496d-8d50-565c3b5d2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:12.306435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 197/404] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:12.330045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df72f93-8ff0-4bbf-b9ee-1261cc96ff11 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:12.350631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 208/405] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:12.382692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5ee2d-f279-496d-8d50-565c3b5d2727 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:12.487432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df72f93-8ff0-4bbf-b9ee-1261cc96ff11 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:12.523698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:12.524899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.525397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.525863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.542580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:12.557087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:53:12.560402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 198/406] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:53:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:12.566751 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5ee2d-f279-496d-8d50-565c3b5d2727 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:12.567863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:12.612418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:12.613128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.613404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.613669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.624119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:12.631596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:12.633065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 209/407] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:12.643565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:12.717939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9551405-5cd2-45f8-9918-5ade1caafe66 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:12.780363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:12.782027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.784066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.784825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.785600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:12.785910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:12.791804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:12.805929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 199/408] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:12.814444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:12.841485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973f4de-91fa-4afb-a97f-3049d473233e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:12.903969 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:12.905013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:12.905292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:12.905561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:12.906374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:12.906818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:12.908373 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:12.923098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 210/409] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:12.927314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:12.967364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534bbd-5b2d-4c90-a18a-93c57ae58bca None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:13.012396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:13.013265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.013557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.013810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.016984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:13.018428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:13.020074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 200/410] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:12 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:13.025792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:13.146444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba3554-7d2f-41fe-82bd-36caac3a4717 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:13.164595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9a15-3376-4f11-a153-779f6f4dc580 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:13.186068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:13.188436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.189543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.190120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.193675 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:13.196067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:13.198053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 201/411] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:13 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:13.208657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:13.236154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:13.238018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.239224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.241257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] PATH_INFO: `/v3/groups/e4d4fbb1afb04128bfcd84bfc91abf5b` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.243475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] RBAC: Authorizing `identity:get_group(group_id=e4d4fbb1afb04128bfcd84bfc91abf5b)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:13.247180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:13.250455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 211/412] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:12 2022] GET /identity/v3/groups/e4d4fbb1afb04128bfcd84bfc91abf5b => generated 229 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:13.255294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:13.375649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50472694-2b1d-433e-b814-8ddafc218c37 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:13.435320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1dd00-f541-4448-ab97-4d4d9cfd70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:13.436127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1dd00-f541-4448-ab97-4d4d9cfd70d9 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.436406 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1dd00-f541-4448-ab97-4d4d9cfd70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.436674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1dd00-f541-4448-ab97-4d4d9cfd70d9 None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082/groups/454a920d4d8940a1879c5181a019f8e9/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.442223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1dd00-f541-4448-ab97-4d4d9cfd70d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c7efcccade14922af9a4a4425790082, group_id=454a920d4d8940a1879c5181a019f8e9, role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:13.443698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1dd00-f541-4448-ab97-4d4d9cfd70d9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:13.454091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd214260-18f9-4d81-ab84-03f2d61448f8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:13.489240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a901da-089f-447e-8a26-982a17483432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:13.490360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a901da-089f-447e-8a26-982a17483432 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.490675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a901da-089f-447e-8a26-982a17483432 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.490952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a901da-089f-447e-8a26-982a17483432 None admin] PATH_INFO: `/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.492195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a901da-089f-447e-8a26-982a17483432 None admin] RBAC: Authorizing `identity:get_project(project_id=742ba5e3bf724a7681af774ed2a8d3b2)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:13.493685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a901da-089f-447e-8a26-982a17483432 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:13.495692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 212/413] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:13 2022] GET /identity/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2 => generated 344 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:13.500995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a901da-089f-447e-8a26-982a17483432 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:13.567692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 202/414] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Mar 31 17:53:13 2022] PUT /identity/v3/projects/2c7efcccade14922af9a4a4425790082/groups/454a920d4d8940a1879c5181a019f8e9/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:53:13.619949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a901da-089f-447e-8a26-982a17483432 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:13.658688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6f2c-fb79-41ea-a066-359e8a1a2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:13.659868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6f2c-fb79-41ea-a066-359e8a1a2537 None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.660323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6f2c-fb79-41ea-a066-359e8a1a2537 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.660752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6f2c-fb79-41ea-a066-359e8a1a2537 None admin] PATH_INFO: `/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2/groups/e4d4fbb1afb04128bfcd84bfc91abf5b/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.663007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6f2c-fb79-41ea-a066-359e8a1a2537 None admin] RBAC: Authorizing `identity:create_grant(project_id=742ba5e3bf724a7681af774ed2a8d3b2, group_id=e4d4fbb1afb04128bfcd84bfc91abf5b, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:13.664737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6f2c-fb79-41ea-a066-359e8a1a2537 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:13.764725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 213/415] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Mar 31 17:53:13 2022] PUT /identity/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2/groups/e4d4fbb1afb04128bfcd84bfc91abf5b/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:53:13.954597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422d1a-c44a-44af-a32b-435ba8eb7aaa None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.955606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422d1a-c44a-44af-a32b-435ba8eb7aaa None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.956111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422d1a-c44a-44af-a32b-435ba8eb7aaa None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.958590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 203/416] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:13.964248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4a45-485c-424b-9142-140f95b0b94f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:13.964919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4a45-485c-424b-9142-140f95b0b94f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:13.965396 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4a45-485c-424b-9142-140f95b0b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:13.990200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0cdd4a45-485c-424b-9142-140f95b0b94f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:13.991753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0cdd4a45-485c-424b-9142-140f95b0b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:14.074338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 214/417] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:14.098933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422d1a-c44a-44af-a32b-435ba8eb7aaa None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:14.216248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422d1a-c44a-44af-a32b-435ba8eb7aaa None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:14.259645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785750-5368-4cc0-9dd0-6edfe5e45ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:14.260452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785750-5368-4cc0-9dd0-6edfe5e45ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.260737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785750-5368-4cc0-9dd0-6edfe5e45ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.261014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785750-5368-4cc0-9dd0-6edfe5e45ae9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.272217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785750-5368-4cc0-9dd0-6edfe5e45ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:14.279334 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-51785750-5368-4cc0-9dd0-6edfe5e45ae9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:53:14.281523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 204/418] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:14.287029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4a45-485c-424b-9142-140f95b0b94f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:14.337640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565867-7529-4f06-addd-cd373a8c0b1f None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.338192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565867-7529-4f06-addd-cd373a8c0b1f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.338470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565867-7529-4f06-addd-cd373a8c0b1f None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.341013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 205/419] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:14.347531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d488-4760-467a-9179-967e67299664 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.348178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d488-4760-467a-9179-967e67299664 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.348579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d488-4760-467a-9179-967e67299664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.371385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-31e5d488-4760-467a-9179-967e67299664 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:14.372572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-31e5d488-4760-467a-9179-967e67299664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:14.479703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 206/420] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:14.492174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4a45-485c-424b-9142-140f95b0b94f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:14.520644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d488-4760-467a-9179-967e67299664 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:14.539879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:14.540902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.541378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.541876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.542838 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] RBAC: Adding query filter params (name=member) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:14.543335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:14.544885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:14.562039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 215/421] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:14.568440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:14.629203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d488-4760-467a-9179-967e67299664 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:14.676663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:14.678512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.679636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.681197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.696771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:14.705294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:53:14.707837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 207/422] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:53:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:14.715879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:14.763526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f02593-fce5-4b69-9fa5-44ee26620b09 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:14.807530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284685b-f5c5-49a2-9347-525967fcbfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:14.808184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284685b-f5c5-49a2-9347-525967fcbfbf None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.808463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284685b-f5c5-49a2-9347-525967fcbfbf None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.808739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284685b-f5c5-49a2-9347-525967fcbfbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.842421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355addc9-935b-4820-ae81-6f9184ea9f77 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:14.879370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284685b-f5c5-49a2-9347-525967fcbfbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:14.880634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284685b-f5c5-49a2-9347-525967fcbfbf None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:14.885410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9cdc-1626-4c0d-a392-a2f4f58ebe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:14.886355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9cdc-1626-4c0d-a392-a2f4f58ebe8b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.886861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9cdc-1626-4c0d-a392-a2f4f58ebe8b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.887329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9cdc-1626-4c0d-a392-a2f4f58ebe8b None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.888261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9cdc-1626-4c0d-a392-a2f4f58ebe8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:14.889162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9cdc-1626-4c0d-a392-a2f4f58ebe8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:14.890811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9cdc-1626-4c0d-a392-a2f4f58ebe8b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:14.902084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 208/423] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:14.903872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38064484-6be8-4eeb-b8ad-f500597ce736 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.904372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38064484-6be8-4eeb-b8ad-f500597ce736 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.904837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38064484-6be8-4eeb-b8ad-f500597ce736 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:14.907478 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 209/424] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:14.908544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38064484-6be8-4eeb-b8ad-f500597ce736 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:14.993946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 216/425] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:53:14.993946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d982c-29c3-414a-b6ad-be236e2ed988 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:14.993946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d982c-29c3-414a-b6ad-be236e2ed988 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:14.993946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d982c-29c3-414a-b6ad-be236e2ed988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.010238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-fe6d982c-29c3-414a-b6ad-be236e2ed988 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:15.011583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-fe6d982c-29c3-414a-b6ad-be236e2ed988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:15.044658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38064484-6be8-4eeb-b8ad-f500597ce736 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.085595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 217/426] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:15.086929 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d982c-29c3-414a-b6ad-be236e2ed988 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.105159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.106704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.107184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.108062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.201124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d982c-29c3-414a-b6ad-be236e2ed988 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.202508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:15.205541 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:15.235307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.236270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.236609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.236955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.238248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:15.240102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:15.241799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 218/427] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:15.242680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.318989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 210/428] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:15.324137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.359730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2da8d-f4be-4968-b611-3d26eff102a2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.399713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.401393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.401393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.402121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.415082 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:15.424355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 31 17:53:15.430640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 219/429] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:15.430640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.440374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df0a3-46f7-4475-b8b1-d1ded95bda3f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.487718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.488642 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.488921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.489872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.491260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:15.493048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:15.498783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 211/430] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:15.500442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.543464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc1d9c-4cb6-4dd9-8fd2-eaff930c0f7e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.585333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.586200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.586482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.586786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] PATH_INFO: `/v3/projects/16004a326feb4230b6b46f54063e1069` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.588060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] RBAC: Authorizing `identity:get_project(project_id=16004a326feb4230b6b46f54063e1069)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:15.589935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:15.592695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 220/431] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/projects/16004a326feb4230b6b46f54063e1069 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:15.593791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.622277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d607-fd5f-4991-8ff5-f59ac6b4dbc0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.665828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.666508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.666825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.667099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.667855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] RBAC: Adding query filter params (name=member) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:15.668159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:15.669940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:15.681504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 212/432] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:15.682723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.695933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db1474-0f8c-4625-bef2-0c60d0658e9a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.728594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.729175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.729453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.729723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.730560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=16004a326feb4230b6b46f54063e1069) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:15.730896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:15.732312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:15.747148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 221/433] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:15.747951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.810182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e27cc-c890-4ffb-abe6-55cd38310e49 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:15.852377 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:15.854217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:15.854920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:15.855581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:15.857574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:15.859953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:15.863270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 213/434] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:15.876049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:15.961255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223dce9-5c14-4a3c-8b4a-c19cb17c2c70 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.003991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99241bbf-715c-4caf-b77b-7656c98fd554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.005687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241bbf-715c-4caf-b77b-7656c98fd554 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.006470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241bbf-715c-4caf-b77b-7656c98fd554 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.007004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241bbf-715c-4caf-b77b-7656c98fd554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.052880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c24921-aed8-4a47-b792-7bd339628e46 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.089265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99241bbf-715c-4caf-b77b-7656c98fd554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:16.090821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99241bbf-715c-4caf-b77b-7656c98fd554 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:16.101527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.102690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.103558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.104043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.105626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=16004a326feb4230b6b46f54063e1069) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:16.106263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:16.108379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:16.116686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 214/435] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=16004a326feb4230b6b46f54063e1069&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:16.204395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 222/436] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:16.210249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.320531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d46d65-1a51-4b91-9cb6-6dec16d9ceee None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.325621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a6680-69e8-43be-8a00-f61a0f6e48a9 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.325925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a6680-69e8-43be-8a00-f61a0f6e48a9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.326171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a6680-69e8-43be-8a00-f61a0f6e48a9 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.330674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 223/437] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:16.333906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae59d-e354-434c-bbd3-a6d2c8b19306 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.334197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae59d-e354-434c-bbd3-a6d2c8b19306 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.334473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae59d-e354-434c-bbd3-a6d2c8b19306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.353387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-bd0ae59d-e354-434c-bbd3-a6d2c8b19306 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:16.354565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bd0ae59d-e354-434c-bbd3-a6d2c8b19306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:16.377837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.378742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.379023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.379295 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.380504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:16.381944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:16.388358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 215/438] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:16.389725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.440138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 224/439] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:16.441694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9908b0-51ba-415d-8cda-2dd2aa5af211 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.442203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9908b0-51ba-415d-8cda-2dd2aa5af211 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.442674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9908b0-51ba-415d-8cda-2dd2aa5af211 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.444758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 225/440] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:16.450501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fba3a-4a03-4990-b45f-7593056950d1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.451292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fba3a-4a03-4990-b45f-7593056950d1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.458330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fba3a-4a03-4990-b45f-7593056950d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.472097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-944fba3a-4a03-4990-b45f-7593056950d1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:16.473279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-944fba3a-4a03-4990-b45f-7593056950d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:16.511108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cf770-e6c5-4713-b1c7-6295893ffdab None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.550031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.550926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.551207 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.551479 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.552850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 226/441] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:16.553577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fba3a-4a03-4990-b45f-7593056950d1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.553734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:16.555225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:16.558040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 216/442] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:16.564308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.668688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3424e24-647d-4dea-92fb-b5f3e05d0d97 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.668863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fba3a-4a03-4990-b45f-7593056950d1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.705988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.706719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.707007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.707283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.708055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.708164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=7e3d435fdd2047a4bf96a5fc9661c311, scope.project.id=2c7efcccade14922af9a4a4425790082) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:16.708413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:16.708860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.709143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.709420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.709833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:16.715527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 217/443] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=7e3d435fdd2047a4bf96a5fc9661c311 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:16.716362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.720208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:16.727806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:53:16.733887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 227/444] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:16.735775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.822803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc74a-b4d6-4105-a84b-55eda141b1ad None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.841573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c715f26-4cf9-4145-b03a-1fe77ca31b25 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:16.857573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.858391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.858704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.858990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.870485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:16.876683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:16.877367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:16.877649 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:16.877926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:16.878182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:16.878717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:16.879028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:16.879635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 218/445] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:16.880415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:16.885358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.894420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 228/446] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:16.895540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:16.995960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d608db-a8c4-40cd-ad3a-e7bb69390d31 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.015939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd348-11f7-4157-b9be-c2dbbc8d2207 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.036143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.036827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.037114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.037395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.038155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:17.038463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.039999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.049667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 219/447] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:17.052027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.054536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.054536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.054536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.055026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:17.130849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.132280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.161870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb64fc-b1e2-4d1a-9051-e09cc49f1692 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.193038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.193687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.193973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.194254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.225469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 229/448] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:53:17.231039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:17.259230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.260613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.323699 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce0a22-36b8-4fd6-9862-5389d4ce1f20 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.352107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 220/449] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:53:17.354963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.355806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.356082 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.356699 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] PATH_INFO: `/v3/projects/2c7efcccade14922af9a4a4425790082` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.357512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:17.357662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] RBAC: Authorizing `identity:get_project(project_id=2c7efcccade14922af9a4a4425790082)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.359111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.361618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 230/450] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:17 2022] GET /identity/v3/projects/2c7efcccade14922af9a4a4425790082 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:17.366886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:17.453186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a4b1d-15fc-4729-9a41-10c9a883ff80 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.460182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e195-578b-49f1-8796-98a690f17ecb None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.485193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.486037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.486317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.486588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] PATH_INFO: `/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.487785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] RBAC: Authorizing `identity:get_project(project_id=742ba5e3bf724a7681af774ed2a8d3b2)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.489204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.491147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 221/451] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:53:17 2022] GET /identity/v3/projects/742ba5e3bf724a7681af774ed2a8d3b2 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:17.493721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.494560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.494861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.495128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] PATH_INFO: `/v3/groups/454a920d4d8940a1879c5181a019f8e9` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.496488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:17.496868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] RBAC: Authorizing `identity:get_group(group_id=454a920d4d8940a1879c5181a019f8e9)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.498275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.500484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 231/452] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:17 2022] GET /identity/v3/groups/454a920d4d8940a1879c5181a019f8e9 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:17.505910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:17.589071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e6f7c-9718-4da6-836e-3300c200c938 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.598094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235495-a146-423b-b4f6-545db44e0b95 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.621620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.622453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.622791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.623063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] PATH_INFO: `/v3/groups/e4d4fbb1afb04128bfcd84bfc91abf5b` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.624215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] RBAC: Authorizing `identity:get_group(group_id=e4d4fbb1afb04128bfcd84bfc91abf5b)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.625741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.627383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 222/453] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Mar 31 17:53:17 2022] GET /identity/v3/groups/e4d4fbb1afb04128bfcd84bfc91abf5b => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:17.630162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441640e7-9cd3-4c71-ac93-3e7304ec73c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.630837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441640e7-9cd3-4c71-ac93-3e7304ec73c9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.631118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441640e7-9cd3-4c71-ac93-3e7304ec73c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.631394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441640e7-9cd3-4c71-ac93-3e7304ec73c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.632217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441640e7-9cd3-4c71-ac93-3e7304ec73c9 None admin] RBAC: Adding query filter params (group.id=454a920d4d8940a1879c5181a019f8e9, role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=2c7efcccade14922af9a4a4425790082) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:17.632528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441640e7-9cd3-4c71-ac93-3e7304ec73c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.633093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:17.633926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441640e7-9cd3-4c71-ac93-3e7304ec73c9 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.639584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 232/454] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:17 2022] GET /identity/v3/role_assignments?group.id=454a920d4d8940a1879c5181a019f8e9&scope.project.id=2c7efcccade14922af9a4a4425790082&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:17.732828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1826b2-c57f-4504-bc85-562cbde6ef05 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:17.767887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5995624-6473-4fc8-913c-c16d82ff7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:17.768547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995624-6473-4fc8-913c-c16d82ff7e7e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:17.768825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995624-6473-4fc8-913c-c16d82ff7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:17.769096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995624-6473-4fc8-913c-c16d82ff7e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:17.769935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5995624-6473-4fc8-913c-c16d82ff7e7e None admin] RBAC: Adding query filter params (group.id=e4d4fbb1afb04128bfcd84bfc91abf5b, role.id=641f3a975368436eac3de51f3605c569, scope.project.id=742ba5e3bf724a7681af774ed2a8d3b2) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:17.770243 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5995624-6473-4fc8-913c-c16d82ff7e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:17.771728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5995624-6473-4fc8-913c-c16d82ff7e7e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:17.778145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 223/455] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Mar 31 17:53:17 2022] GET /identity/v3/role_assignments?group.id=e4d4fbb1afb04128bfcd84bfc91abf5b&scope.project.id=742ba5e3bf724a7681af774ed2a8d3b2&role.id=641f3a975368436eac3de51f3605c569 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:20.743855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1be05-65f9-44e7-a670-7868ff706520 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:20.744965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1be05-65f9-44e7-a670-7868ff706520 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:20.745456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1be05-65f9-44e7-a670-7868ff706520 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:20.747905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 233/456] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:20.755593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d877-4e1a-4bb6-b32f-ad85a86f7146 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:20.756554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d877-4e1a-4bb6-b32f-ad85a86f7146 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:20.757074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d877-4e1a-4bb6-b32f-ad85a86f7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:20.776255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1898d877-4e1a-4bb6-b32f-ad85a86f7146 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:20.777769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1898d877-4e1a-4bb6-b32f-ad85a86f7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:20.865964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 224/457] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:20.892213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1be05-65f9-44e7-a670-7868ff706520 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:20.988485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18e31f-65f1-49b9-a76b-8456106c6057 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:20.988805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18e31f-65f1-49b9-a76b-8456106c6057 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:20.989053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18e31f-65f1-49b9-a76b-8456106c6057 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:20.991925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 225/458] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:20.997229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20f1b-b043-406a-a9d3-d3b07380f0d4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:20.997449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20f1b-b043-406a-a9d3-d3b07380f0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:20.997727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20f1b-b043-406a-a9d3-d3b07380f0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.020896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-8ab20f1b-b043-406a-a9d3-d3b07380f0d4 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:21.022404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8ab20f1b-b043-406a-a9d3-d3b07380f0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:21.063511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1be05-65f9-44e7-a670-7868ff706520 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.111405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85867-892c-4011-b4df-8e07dc205b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.112216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85867-892c-4011-b4df-8e07dc205b88 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.112497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85867-892c-4011-b4df-8e07dc205b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.112772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85867-892c-4011-b4df-8e07dc205b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.123794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85867-892c-4011-b4df-8e07dc205b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.125746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85867-892c-4011-b4df-8e07dc205b88 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.128229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 226/459] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:21.130051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb076-38de-4ee7-af21-f9b2fbab3f63 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.130564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb076-38de-4ee7-af21-f9b2fbab3f63 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.131063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb076-38de-4ee7-af21-f9b2fbab3f63 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.133030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 227/460] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:21.134474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eea3-438d-4d0f-a56e-9edc6a10b5de None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.134960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eea3-438d-4d0f-a56e-9edc6a10b5de None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.135412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eea3-438d-4d0f-a56e-9edc6a10b5de None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.137401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 228/461] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:21.143299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319455f-c253-4fcd-8739-5a9e7c33cf72 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.143821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319455f-c253-4fcd-8739-5a9e7c33cf72 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.144300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319455f-c253-4fcd-8739-5a9e7c33cf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.151254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d9b85867-892c-4011-b4df-8e07dc205b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:21.152761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 234/462] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:21.158176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f35e-0616-47c0-9692-7370b761b75e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.158773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f35e-0616-47c0-9692-7370b761b75e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.159059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f35e-0616-47c0-9692-7370b761b75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.164881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6319455f-c253-4fcd-8739-5a9e7c33cf72 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:21.166164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6319455f-c253-4fcd-8739-5a9e7c33cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:21.175528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-bf62f35e-0616-47c0-9692-7370b761b75e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:21.176690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bf62f35e-0616-47c0-9692-7370b761b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:21.242958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 229/463] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:21.244353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319455f-c253-4fcd-8739-5a9e7c33cf72 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.247443 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 235/464] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:21.248474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f35e-0616-47c0-9692-7370b761b75e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.346742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f35e-0616-47c0-9692-7370b761b75e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.351829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319455f-c253-4fcd-8739-5a9e7c33cf72 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.382942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.383748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.383950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.384235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.384982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:21.385289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.386942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.388577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.389373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.389658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.389933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.401226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.402705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.408646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 236/465] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:21.409648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.423933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:21.425365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 230/466] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:21.425899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.517690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581fc3-d648-445a-9577-362b51882615 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.525414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b0e34-48a1-40c6-8c01-1f20d227c2cb None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.552185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.552972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.553255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.553530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.562654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.564319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.564678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.564795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.564950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.566181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.575112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.576542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.585282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:21.591857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 237/467] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:21.591857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.594577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:21.596118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 231/468] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:21.597017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.697566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbafbb-e650-4dc5-bb63-ee85e9fc6d5f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.699746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23414-3e70-4584-b612-72d00fa0e59f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.734570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.735542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.735819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.736094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.736631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.736814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.737290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.737569 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.737842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.738264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.738560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:21.738895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.740591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.752112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 232/469] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:21.752917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.849931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8975-b93a-43b1-85e6-228bee171650 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:21.873041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 238/470] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:53:21 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:21.875713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.891847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:21.892944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:21.893475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:21.894036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:21.895057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:21.895584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:21.897207 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:21.912703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 233/471] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:21.913873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:21.985953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad03cd-f792-483d-b100-5054a6b3cc81 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:22.020338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c034-cf99-4d7d-978f-228a69fb0d9c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:22.021358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:22.022062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.022343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.022630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.023409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:22.023719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:22.025109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:22.038203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 239/472] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:22.043645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:22.064861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4028bb-f93a-4382-9ba5-552e6296bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:22.065469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4028bb-f93a-4382-9ba5-552e6296bb3f None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.066244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4028bb-f93a-4382-9ba5-552e6296bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.066244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4028bb-f93a-4382-9ba5-552e6296bb3f None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.066804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4028bb-f93a-4382-9ba5-552e6296bb3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:22.068192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4028bb-f93a-4382-9ba5-552e6296bb3f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:22.146596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 234/473] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:53:21 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:22.147953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de405-da8b-4a84-897e-1923d265dc78 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.148248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de405-da8b-4a84-897e-1923d265dc78 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.148538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320de405-da8b-4a84-897e-1923d265dc78 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.150380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 235/474] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:22.155268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320de405-da8b-4a84-897e-1923d265dc78 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:22.158061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69cec-7c95-4bad-a330-f9f03244e332 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:22.207824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eafe77-1e93-4f39-8a01-79205ad32488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:22.208879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eafe77-1e93-4f39-8a01-79205ad32488 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.209429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eafe77-1e93-4f39-8a01-79205ad32488 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.209886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eafe77-1e93-4f39-8a01-79205ad32488 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.211087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eafe77-1e93-4f39-8a01-79205ad32488 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:22.213695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eafe77-1e93-4f39-8a01-79205ad32488 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:22.274763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320de405-da8b-4a84-897e-1923d265dc78 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:22.318967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:22.319176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 240/475] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:53:22 2022] POST /identity/v3/users => generated 248 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:22.320117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.320624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f630c3-e610-4eba-8d79-e86730f0fefe None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.320918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f630c3-e610-4eba-8d79-e86730f0fefe None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.321196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.321308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f630c3-e610-4eba-8d79-e86730f0fefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.321880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.323001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:22.324806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:22.360638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-87f630c3-e610-4eba-8d79-e86730f0fefe None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:22.361870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-87f630c3-e610-4eba-8d79-e86730f0fefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:22.417275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 236/476] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:53:22 2022] POST /identity/v3/users => generated 249 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:22.458890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 241/477] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:22.487264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:22.630487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda551a-4e9e-4448-95bd-41816c0d5463 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:22.671498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:22.672278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.672507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.672883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.673657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:22.675113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:22.730764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.sql.core [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 31 17:53:22.730764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 31 17:53:22.730764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [parameters: {'id': '4a7896fc04bc49318643337c94c99c5a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 31 17:53:22.730764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79917) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 31 17:53:22.748014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 31 17:53:22.751078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 237/478] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Mar 31 17:53:22 2022] POST /identity/v3/roles => generated 144 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:22.755928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f630c3-e610-4eba-8d79-e86730f0fefe None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:22.861201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f630c3-e610-4eba-8d79-e86730f0fefe None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:22.902094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f043fa-561c-414e-99d6-524516470ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:22.902929 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f043fa-561c-414e-99d6-524516470ab6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:22.903201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f043fa-561c-414e-99d6-524516470ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:22.903599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f043fa-561c-414e-99d6-524516470ab6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:22.919947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f043fa-561c-414e-99d6-524516470ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:22.927535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-49f043fa-561c-414e-99d6-524516470ab6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 31 17:53:22.928904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 242/479] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:53:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:22.934479 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:23.082514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c93b04-1061-4670-a3dc-d6936d6d1441 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:23.130285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bb1a5-4f20-4a31-867d-3bf328d13507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:23.131027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bb1a5-4f20-4a31-867d-3bf328d13507 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:23.131293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bb1a5-4f20-4a31-867d-3bf328d13507 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:23.131576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bb1a5-4f20-4a31-867d-3bf328d13507 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:23.132342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bb1a5-4f20-4a31-867d-3bf328d13507 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:23.132651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bb1a5-4f20-4a31-867d-3bf328d13507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:23.134041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bb1a5-4f20-4a31-867d-3bf328d13507 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:23.143679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 238/480] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:24.485967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ccb6-0662-4f42-90e7-fd9718920234 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:24.486590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ccb6-0662-4f42-90e7-fd9718920234 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:24.486590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ccb6-0662-4f42-90e7-fd9718920234 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:24.488608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 243/481] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:24.504335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806b93-969b-4abe-adcc-2c99b6fdf33a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:24.505238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806b93-969b-4abe-adcc-2c99b6fdf33a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:24.505731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806b93-969b-4abe-adcc-2c99b6fdf33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:24.535650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ec806b93-969b-4abe-adcc-2c99b6fdf33a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:24.537194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ec806b93-969b-4abe-adcc-2c99b6fdf33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:24.626038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 239/482] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:24.661156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ccb6-0662-4f42-90e7-fd9718920234 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:24.792382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ccb6-0662-4f42-90e7-fd9718920234 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:24.840251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:24.841430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:24.841912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:24.842381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:24.861387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:24.869022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:24.874942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 244/483] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:24.876834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806b93-969b-4abe-adcc-2c99b6fdf33a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.049705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806b93-969b-4abe-adcc-2c99b6fdf33a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.102074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be56c0-3f4b-4942-83e4-44f66e0b46d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:25.102770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be56c0-3f4b-4942-83e4-44f66e0b46d0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.103050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be56c0-3f4b-4942-83e4-44f66e0b46d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.103320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be56c0-3f4b-4942-83e4-44f66e0b46d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.104065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be56c0-3f4b-4942-83e4-44f66e0b46d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:25.104368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be56c0-3f4b-4942-83e4-44f66e0b46d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:25.105711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be56c0-3f4b-4942-83e4-44f66e0b46d0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:25.118789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 240/484] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:25.120021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.147107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f59d5-8f18-40ae-9c5b-b2a4510031d6 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.147387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f59d5-8f18-40ae-9c5b-b2a4510031d6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.147829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f59d5-8f18-40ae-9c5b-b2a4510031d6 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.150026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 241/485] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:25.163815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8a56-927b-4a5c-b408-3bdd675891da None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.164365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8a56-927b-4a5c-b408-3bdd675891da None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.164895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8a56-927b-4a5c-b408-3bdd675891da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.197378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-42cb8a56-927b-4a5c-b408-3bdd675891da None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:25.198888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-42cb8a56-927b-4a5c-b408-3bdd675891da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:25.245037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8125e05-8d5b-44a6-96d0-f894fc760b78 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.287074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e160-ea81-476e-9f2f-831d7fd9563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:25.287883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e160-ea81-476e-9f2f-831d7fd9563e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.288164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e160-ea81-476e-9f2f-831d7fd9563e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.288439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e160-ea81-476e-9f2f-831d7fd9563e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.308914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5e160-ea81-476e-9f2f-831d7fd9563e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:25.310591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5e160-ea81-476e-9f2f-831d7fd9563e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:25.322632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 242/486] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:25.322632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0989bda-0d17-457f-9eea-135319381421 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.322632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0989bda-0d17-457f-9eea-135319381421 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.322632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0989bda-0d17-457f-9eea-135319381421 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.322632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 243/487] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:25.333066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-93d5e160-ea81-476e-9f2f-831d7fd9563e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:25.334534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 245/488] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:25.339785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0989bda-0d17-457f-9eea-135319381421 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.349481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ec1e-42e1-40da-bb7b-04c7d203c00a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.349766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ec1e-42e1-40da-bb7b-04c7d203c00a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.350037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ec1e-42e1-40da-bb7b-04c7d203c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.370458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2014ec1e-42e1-40da-bb7b-04c7d203c00a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:25.371879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2014ec1e-42e1-40da-bb7b-04c7d203c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:25.544119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0989bda-0d17-457f-9eea-135319381421 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.544628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 246/489] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:25.545405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ec1e-42e1-40da-bb7b-04c7d203c00a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.584713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763a952-6813-4731-8090-0110a53fccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:25.585292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a952-6813-4731-8090-0110a53fccc7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.585567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a952-6813-4731-8090-0110a53fccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.585837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a952-6813-4731-8090-0110a53fccc7 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.586587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763a952-6813-4731-8090-0110a53fccc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:25.586923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763a952-6813-4731-8090-0110a53fccc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:25.588272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763a952-6813-4731-8090-0110a53fccc7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:25.605036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 244/490] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:25.605036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aea91-9402-42b9-8495-1d8a5c6d6df5 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.605036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aea91-9402-42b9-8495-1d8a5c6d6df5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.605036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aea91-9402-42b9-8495-1d8a5c6d6df5 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.605036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 245/491] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:25.605036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aea91-9402-42b9-8495-1d8a5c6d6df5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.645375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ec1e-42e1-40da-bb7b-04c7d203c00a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.680125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:25.680884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.681161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.681429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.691429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:25.698214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:25.699589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 247/492] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:25.700180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.713074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aea91-9402-42b9-8495-1d8a5c6d6df5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.747077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f9ccf-4b7b-4675-8f56-3765f6d512b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:25.747876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f9ccf-4b7b-4675-8f56-3765f6d512b3 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.748171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f9ccf-4b7b-4675-8f56-3765f6d512b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.748432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f9ccf-4b7b-4675-8f56-3765f6d512b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.759972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f9ccf-4b7b-4675-8f56-3765f6d512b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:25.767236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-e60f9ccf-4b7b-4675-8f56-3765f6d512b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:25.773235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 246/493] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:25.773235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca1d7-730b-42c8-97c8-70e641fd06dc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.773235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca1d7-730b-42c8-97c8-70e641fd06dc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.773235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca1d7-730b-42c8-97c8-70e641fd06dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.788404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-24eca1d7-730b-42c8-97c8-70e641fd06dc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:25.789575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-24eca1d7-730b-42c8-97c8-70e641fd06dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:25.806546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64492dba-9d7b-4d9a-8a1e-696f7cf0ed88 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.840688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:25.841398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.841680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.841957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.851238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:25.852687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:25.862640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 247/494] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:25.862640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca1d7-730b-42c8-97c8-70e641fd06dc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.874065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:53:25.876243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 248/495] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:53:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:25.876895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:25.962251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca1d7-730b-42c8-97c8-70e641fd06dc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.974709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5eac04-2d5e-42e0-9e29-79d7ee1e345d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:25.996990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:25.997567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:25.997844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:25.998122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:25.998884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:25.999188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.001133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.008685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.009276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 248/496] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:26.009862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.013664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.013957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.014238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.015037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:26.015350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.017176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.029579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 249/497] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:26.029579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.107006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312666f7-6082-4825-a65e-7282d4c458c4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.133178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05970a83-316b-45ff-b0d0-9de08b0307d8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.140084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.140755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.141643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.142099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.143039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:26.143350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.144800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.165610 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.166400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.166714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.166983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.176593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:26.181264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 249/498] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:26.182089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.183453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:26.184648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 250/499] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:26.187466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.277394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767acad8-c22f-4237-b701-922897d8a73c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.282733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9e1d-7af2-4340-8896-6d97d5c998e0 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.310518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193c6d3-795a-4e2b-b38e-c894c9902bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.311328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193c6d3-795a-4e2b-b38e-c894c9902bef None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.311614 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193c6d3-795a-4e2b-b38e-c894c9902bef None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.311879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193c6d3-795a-4e2b-b38e-c894c9902bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.314712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.315503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.315785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.316060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.321608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193c6d3-795a-4e2b-b38e-c894c9902bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.323093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193c6d3-795a-4e2b-b38e-c894c9902bef None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.326254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.327710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.340095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-7193c6d3-795a-4e2b-b38e-c894c9902bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:26.341472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 250/500] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:26.342693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21386-fc15-4f57-81c5-13dede4237fb None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.342977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21386-fc15-4f57-81c5-13dede4237fb None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.343272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21386-fc15-4f57-81c5-13dede4237fb None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.345366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:26.345885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 251/501] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:26.347350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21386-fc15-4f57-81c5-13dede4237fb None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.351456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 251/502] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:26.351681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.442697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21386-fc15-4f57-81c5-13dede4237fb None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.446217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc019a50-9b9a-4644-a750-a03992e9de61 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.473426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.474060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.474339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.474626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.478795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.479381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.479663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.479941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.480689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:26.480996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.482355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.491151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 252/503] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:26.491954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.541711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.543197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.588482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e223ba-4d28-47ee-8843-98234b8a9f95 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.621282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da801e29-0535-4ae8-8326-68d5ec653419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.621931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801e29-0535-4ae8-8326-68d5ec653419 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.622208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801e29-0535-4ae8-8326-68d5ec653419 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.622484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da801e29-0535-4ae8-8326-68d5ec653419 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.623224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da801e29-0535-4ae8-8326-68d5ec653419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:26.623528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da801e29-0535-4ae8-8326-68d5ec653419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.624887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da801e29-0535-4ae8-8326-68d5ec653419 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.636842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 253/504] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:26.639260 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb3529-e427-41bc-9f51-06fd88716f89 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.639553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb3529-e427-41bc-9f51-06fd88716f89 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.641912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb3529-e427-41bc-9f51-06fd88716f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.642036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 252/505] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:26.642036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.656020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-17fb3529-e427-41bc-9f51-06fd88716f89 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:26.657830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-17fb3529-e427-41bc-9f51-06fd88716f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:26.720594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 254/506] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:26.721434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb3529-e427-41bc-9f51-06fd88716f89 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.736892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e80f7-5f08-4c2b-9cfb-967265bfa028 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.769123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.769773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.770051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.770323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.771061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:26.771365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.772713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.784222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 253/507] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:26.784845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.816694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb3529-e427-41bc-9f51-06fd88716f89 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.849459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.850241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.850523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.850823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.860630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.862056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.878552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:26.878724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bde5aa-c042-4c5a-9f77-058ffbd906d4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:26.879731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 255/508] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:26.880496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.911556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:26.912351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:26.912634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:26.912911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:26.920179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:26.921629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:26.934757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 31 17:53:26.935928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 254/509] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:26.936706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:26.975457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d9956-8d96-4395-a742-a622a6b7d62c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.007210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.007991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.008269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.008543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.018576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.020038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.030950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbff155-3613-4403-809b-8710c23d26d2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.036565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:27.037731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 256/510] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:27.038485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.065634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.066427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.066737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.067014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.077194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.078678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.094784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:27.095963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 255/511] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:27.096727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.136306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fd627-db3b-4b51-8f83-889c05e5c24f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.168900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.169684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.169965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.170239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.177296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.178773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.191963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cd87-3bcc-4494-971f-573935a21921 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.192438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 31 17:53:27.193604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 257/512] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:27.194360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.224306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.225034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.225320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.225643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.226310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:27.226632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.228014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.239310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 256/513] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:27.240091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.289174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd54e5-6b95-45cd-9d7a-a9e2d4f62cc5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.321150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.321820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.322098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.322367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.323223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:27.323526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.324950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.333307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940813-a94c-4d0d-9e0c-a14ad5020168 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.359832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 258/514] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:27.360739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.364997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.365909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.366185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.366455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.367206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:27.367508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.368858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.380325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 257/515] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:27.382166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.455064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e60e5-6032-4e59-9514-3b2bac38bcda None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.477559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2f6a0-df8b-4ad7-8715-c5043d19975e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.486432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.487120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.487404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.487674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.488391 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:27.488808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.490177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.501759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 259/516] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:27.502536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.510353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.511053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.511333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.511611 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.512442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:27.512758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.514172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.536164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 258/517] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:27.536164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.598023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938fa06-bb2a-49d0-be25-e08c5bf4c7ea None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.626398 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc5a91-d414-4395-8157-1ce5fe122615 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.630441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.631268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.631551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.631827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.639160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.640607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.654138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 31 17:53:27.655315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 260/518] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:27.656069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.663483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.664126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.664405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.664673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.727745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.729128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.753579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59b82-bc99-47f7-96d5-03cd44d054c3 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.786400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.787214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.787490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.787761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.794209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.795678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:27.809541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:27.810700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 261/519] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:27.811432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.827476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 259/520] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:27.827476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:27.912442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0419-782c-4651-b282-6490609cb9eb None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.918680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9703e0-712f-40b9-ae92-b7a087bd1f39 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:27.949521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.950477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.950935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.951234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:27.951341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.951876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:27.952153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:27.952309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:27.952423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:27.954363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.015821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.017238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.038641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 262/521] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:53:27 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:28.038641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.122542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 260/522] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:28.123904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.132367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90214c5e-84b8-450b-b1b7-1b1718315ee0 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.167008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.167695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.167973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.168242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.169084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:28.169389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.170853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.194208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 263/523] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:28.194208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.232176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16054-e5cf-439d-9fe7-9c944b9a2d6b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.272240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.272838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.273124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.273402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.274196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:28.274509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.275973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.294356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 261/524] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:28.298879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.299010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05eb94-faff-4df8-8762-74a46e28e403 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.330412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.331242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.331547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.331796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.341642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.343119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.360803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:28.366882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 264/525] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:28.366882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.397229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d0e1a-53e8-44b0-ac96-d619022cf8c4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.430686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.431484 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.431769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.432106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.442116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.443616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.462741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:28.464113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 262/526] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:28.464710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.496430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf810-32ef-49b7-bf4a-7a71277dffd4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.529641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.530324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.530717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.531002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.561180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e37994-0395-4071-9d74-9d5da10c90a1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.595059 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.595721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.596004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.596279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.597125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7e46af6e41bb45c08e5a6b9fd596e4f1) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:28.597435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.597735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.598880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.599279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.604267 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 263/527] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/role_assignments?user.id=7e46af6e41bb45c08e5a6b9fd596e4f1&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:28.605043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.710914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 265/528] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:28.712234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.715236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd33c5-9169-4449-bdaf-a340dc7aef18 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.754034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.754740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.755023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.755298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.756032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:28.756339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.757743 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.774597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 264/529] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:28.775600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.823795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bee7d-5a22-4cca-8788-c6d3ecdd0258 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.859523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.860622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.861110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.861619 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.862548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:28.863080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.864654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.877214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5999-04b3-4370-8f92-09263b44f362 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:28.882048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 266/530] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:28.882048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.916597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:28.917459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:28.917787 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:28.918067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:28.931340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:28.933414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:28.955387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:28.957100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 265/531] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:28.957957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:28.999190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ada22c-9451-41ba-a3c3-56ad0c6592b1 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.043566 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.044709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.045590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.046052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.061172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.063750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.078375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1b9b-f7b4-402e-a4c8-a15f08844904 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.081747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:29.083424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 267/532] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:29.084363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.114374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.115495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.116254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.116733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.124017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.125739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.140147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:29.142503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 266/533] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:29.143578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.196696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5240e0-a297-485d-92a2-b47c82cac61a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.232783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.233805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.234329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.234898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.235824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:29.236409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.238054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.250492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 268/534] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:29.251763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.273383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825396-0fd7-451c-9887-e483f0b0194c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.313939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.315117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.315602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.316075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.317058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:29.317640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.319354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.333258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 267/535] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:29.334335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.372446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a219c-6237-47bf-9b92-10c7a5210c77 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.410919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.411980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.412516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.412986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.414438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:29.414978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.417000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.440193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bcd15-9c5a-4fee-9c59-e8ba3f7fd6b0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.441178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 269/536] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:29.442146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.480018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.481005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.481389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.481764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.491652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.493979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.512170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:29.514465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 268/537] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:29.515399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.553823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba3dee-89d9-4f33-81a5-2dff5335c020 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.589060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.589273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.589675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.590051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.591017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=5bfec7fb739b42bfa2ddd682aa10dc95) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:29.591428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.593041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.600140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 270/538] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/role_assignments?user.id=5bfec7fb739b42bfa2ddd682aa10dc95&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:29.601165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.624121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18eb03-ba7e-4020-aaa1-9c443d2b98ff None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.661616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.662586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.663046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.663467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.664466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7436a3068f6545a4b74c877c5b8c81c3) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:29.664951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.666603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.673608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 269/539] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/role_assignments?user.id=7436a3068f6545a4b74c877c5b8c81c3&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:29.723595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07490c9-b855-4592-a376-f64200bb2f04 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.769490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969c052-2eb1-437d-84ac-dc79318b1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.770457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c052-2eb1-437d-84ac-dc79318b1a7f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.770913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c052-2eb1-437d-84ac-dc79318b1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.771329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969c052-2eb1-437d-84ac-dc79318b1a7f None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.772286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969c052-2eb1-437d-84ac-dc79318b1a7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:29.772750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969c052-2eb1-437d-84ac-dc79318b1a7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.774341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969c052-2eb1-437d-84ac-dc79318b1a7f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.795142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 271/540] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:29.800896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:29.927411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15481a-652d-41ae-8b2b-4befd9f80774 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:29.964100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd624a-35f8-418d-9007-692279e7d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:29.964756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd624a-35f8-418d-9007-692279e7d196 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:29.965035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd624a-35f8-418d-9007-692279e7d196 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:29.965312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd624a-35f8-418d-9007-692279e7d196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:29.966139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd624a-35f8-418d-9007-692279e7d196 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=95559d1e48934be89e562208ff65d195) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:29.966448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd624a-35f8-418d-9007-692279e7d196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:29.967920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd624a-35f8-418d-9007-692279e7d196 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:29.975067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 270/541] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:29 2022] GET /identity/v3/role_assignments?user.id=95559d1e48934be89e562208ff65d195&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:30.574253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a8f42-dcf9-4f50-bf6f-f3d4e5d48551 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:30.574769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a8f42-dcf9-4f50-bf6f-f3d4e5d48551 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:30.575149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a8f42-dcf9-4f50-bf6f-f3d4e5d48551 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:30.577320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 272/542] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:30.582730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071450-69df-47c6-8efe-724e2c402c8d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:30.583021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071450-69df-47c6-8efe-724e2c402c8d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:30.583300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071450-69df-47c6-8efe-724e2c402c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:30.609340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-08071450-69df-47c6-8efe-724e2c402c8d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:30.610746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-08071450-69df-47c6-8efe-724e2c402c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:30.716883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 271/543] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:30.749643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a8f42-dcf9-4f50-bf6f-f3d4e5d48551 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:30.876569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a8f42-dcf9-4f50-bf6f-f3d4e5d48551 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:30.924586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145dc8c-d139-4399-aed3-f23e9e021c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:30.925393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145dc8c-d139-4399-aed3-f23e9e021c52 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:30.925667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145dc8c-d139-4399-aed3-f23e9e021c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:30.925933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145dc8c-d139-4399-aed3-f23e9e021c52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:30.936380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145dc8c-d139-4399-aed3-f23e9e021c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:30.947680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-7145dc8c-d139-4399-aed3-f23e9e021c52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:30.948872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 273/544] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:30.955721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08071450-69df-47c6-8efe-724e2c402c8d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:31.098762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c814a-9bb7-47c3-8aa9-44a2e8d57d9b None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.099085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c814a-9bb7-47c3-8aa9-44a2e8d57d9b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.099320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c814a-9bb7-47c3-8aa9-44a2e8d57d9b None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.101356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 274/545] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:31.106102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317900cf-a65f-43a4-a00f-84dc5716e4c9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.106387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317900cf-a65f-43a4-a00f-84dc5716e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.106694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317900cf-a65f-43a4-a00f-84dc5716e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.114163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08071450-69df-47c6-8efe-724e2c402c8d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:31.139629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-317900cf-a65f-43a4-a00f-84dc5716e4c9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:31.140758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-317900cf-a65f-43a4-a00f-84dc5716e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:31.181309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:31.181978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.182254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.182524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.183302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:31.183603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:31.185182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:31.198799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 272/546] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:31.204135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:31.260299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 275/547] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:31.304783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317900cf-a65f-43a4-a00f-84dc5716e4c9 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:31.366809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb010-5db5-448e-a249-c4c060e5b926 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:31.435821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317900cf-a65f-43a4-a00f-84dc5716e4c9 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:31.446697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:31.447496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.447772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.448043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.483298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:31.485372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:31.504933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:31.506901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 273/548] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:31.511870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:31.524739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:31.525600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.525873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.526141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.548142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:31.555251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:31.556799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 276/549] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:31.562158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:31.629034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200ef4-d581-4d5d-a34e-397ef5983f54 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:31.698908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:31.699493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.699772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.700045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.700767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:31.701069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:31.702434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:31.730303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 274/550] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:31.734348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:31.739965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1cecd-9ebc-47b0-9dc5-4005aecb9ccc None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:31.773877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:31.775390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.775880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.776353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.777357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:31.777860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:31.779514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:31.788997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 277/551] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:31.794274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:31.905270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f3f7e-887b-4219-819c-bd087eea91a9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:31.943868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:31.945162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:31.945647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:31.946129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] PATH_INFO: `/v3/users/swift` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:31.955300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:31.957075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:31.974487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 31 17:53:31.976332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 275/552] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:31.995354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:32.017793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ed03e-bfa3-48cd-adf0-c7b0e4cc0b14 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.093641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.096060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.096349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.096626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.118930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:32.120434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:32.140211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:32.146633 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 278/553] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:32.147870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:32.238983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350d71-5bb7-415e-bea2-db995a46bbae None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.248965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d818f2-0f19-42c0-94b5-302ff736af58 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.291939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.292442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.292722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.292995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.293720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:32.294022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:32.295416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:32.326182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 279/554] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:32.326919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.327604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.327933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.328213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.329196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:32.329989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:32.331511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:32.344038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:32.371971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 276/555] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Mar 31 17:53:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:32.378448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:32.498766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16715fa-0a82-47d1-b43b-a13f676b97ed None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.528308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8fa9-747a-4612-bc4e-322ccc8dd5b7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.535319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd45b9-be4e-4ee7-9bcd-1dfa5cc0dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.536114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd45b9-be4e-4ee7-9bcd-1dfa5cc0dbba None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.536395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd45b9-be4e-4ee7-9bcd-1dfa5cc0dbba None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.536668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd45b9-be4e-4ee7-9bcd-1dfa5cc0dbba None admin] PATH_INFO: `/v3/users/nova` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.544074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd45b9-be4e-4ee7-9bcd-1dfa5cc0dbba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:32.545526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd45b9-be4e-4ee7-9bcd-1dfa5cc0dbba None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:32.559365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d3cd45b9-be4e-4ee7-9bcd-1dfa5cc0dbba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:53:32.560627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 280/556] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:53:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:32.561925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e45f66-9672-4cda-9a18-c58c7bead434 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.562209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e45f66-9672-4cda-9a18-c58c7bead434 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.562485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e45f66-9672-4cda-9a18-c58c7bead434 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.565155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 281/557] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:32.568483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94597aab-5ab9-4a70-844c-d748469b0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.569537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597aab-5ab9-4a70-844c-d748469b0a01 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.570034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597aab-5ab9-4a70-844c-d748469b0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.570493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2c45-269b-4e20-8738-9cd53dd51bb9 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.570768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597aab-5ab9-4a70-844c-d748469b0a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.570879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2c45-269b-4e20-8738-9cd53dd51bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.571078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2c45-269b-4e20-8738-9cd53dd51bb9 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.572886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 282/558] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:32.573659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c2c45-269b-4e20-8738-9cd53dd51bb9 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:32.644712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94597aab-5ab9-4a70-844c-d748469b0a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:32.646532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94597aab-5ab9-4a70-844c-d748469b0a01 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:32.677148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c2c45-269b-4e20-8738-9cd53dd51bb9 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.710679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4320e-cd12-44b5-a98d-0a69230ac984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.711352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4320e-cd12-44b5-a98d-0a69230ac984 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.711635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4320e-cd12-44b5-a98d-0a69230ac984 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.711914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4320e-cd12-44b5-a98d-0a69230ac984 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.712745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4320e-cd12-44b5-a98d-0a69230ac984 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:32.713056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4320e-cd12-44b5-a98d-0a69230ac984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:32.714531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4320e-cd12-44b5-a98d-0a69230ac984 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:32.732101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 283/559] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:53:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:32.733277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818d3bd-e1f1-46cf-a43f-6765645e805c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.733696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818d3bd-e1f1-46cf-a43f-6765645e805c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.733978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818d3bd-e1f1-46cf-a43f-6765645e805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.753748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-6818d3bd-e1f1-46cf-a43f-6765645e805c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:32.754817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6818d3bd-e1f1-46cf-a43f-6765645e805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:32.756625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 277/560] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:53:32.758073 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f2a6-6d74-4eee-a447-c07b0ca73ca0 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.758366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f2a6-6d74-4eee-a447-c07b0ca73ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.758671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f2a6-6d74-4eee-a447-c07b0ca73ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.775387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7ae1f2a6-6d74-4eee-a447-c07b0ca73ca0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:32.776566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7ae1f2a6-6d74-4eee-a447-c07b0ca73ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:32.826743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 284/561] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:32.828169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818d3bd-e1f1-46cf-a43f-6765645e805c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:32.857585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 278/562] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:32.858213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1f2a6-6d74-4eee-a447-c07b0ca73ca0 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:32.950241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818d3bd-e1f1-46cf-a43f-6765645e805c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.959581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1f2a6-6d74-4eee-a447-c07b0ca73ca0 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:32.983771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.984679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.985494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.985762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.994793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:32.995751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:32.996031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:32.996130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:32.996306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:32.997559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.007512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.008718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.015143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:33.016413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 285/563] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.017316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.026420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:33.027718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 279/564] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.028625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.121614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e533-da8f-4b27-9ed1-d7f51fd62d66 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.127188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33018f-cb61-4f04-bda1-159a54f0b89c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.155456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93522d19-d489-40f1-a5f0-9ffb61494197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.156243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522d19-d489-40f1-a5f0-9ffb61494197 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.156515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522d19-d489-40f1-a5f0-9ffb61494197 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.156815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522d19-d489-40f1-a5f0-9ffb61494197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.159890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.160711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.160996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.161272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.166968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93522d19-d489-40f1-a5f0-9ffb61494197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:33.171862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:33.174664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-93522d19-d489-40f1-a5f0-9ffb61494197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:33.175846 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 286/565] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.177037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374796-aca1-44c1-b3de-890bd6fe28f1 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374796-aca1-44c1-b3de-890bd6fe28f1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.177589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374796-aca1-44c1-b3de-890bd6fe28f1 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.182659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 287/566] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:33.182828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:33.182916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374796-aca1-44c1-b3de-890bd6fe28f1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.182988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 280/567] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.182988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.284793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc081-f430-4f47-87fc-7f4d249f50bc None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.284998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374796-aca1-44c1-b3de-890bd6fe28f1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.317906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.318727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.319017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.319291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.319861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e5f7e-db81-411d-9835-cebc34695522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.320038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:33.320343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.320569 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e5f7e-db81-411d-9835-cebc34695522 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.321028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e5f7e-db81-411d-9835-cebc34695522 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.321313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e5f7e-db81-411d-9835-cebc34695522 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.321697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.322036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e5f7e-db81-411d-9835-cebc34695522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:33.322346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e5f7e-db81-411d-9835-cebc34695522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.323749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e5f7e-db81-411d-9835-cebc34695522 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.333196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 288/568] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:33.334007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.339608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 281/569] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:33.340851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e70e-c67d-4038-98c1-f6612d94921d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.341146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e70e-c67d-4038-98c1-f6612d94921d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.341421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e70e-c67d-4038-98c1-f6612d94921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.358182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5565e70e-c67d-4038-98c1-f6612d94921d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:33.359422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5565e70e-c67d-4038-98c1-f6612d94921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:33.438035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 282/570] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:33.439039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565e70e-c67d-4038-98c1-f6612d94921d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.441555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979767a5-cf63-4cbc-9331-146aeb87581b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.476605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.477708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.478170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.478451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.479490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:33.480065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.481939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.493426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 289/571] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:33.494251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.542458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565e70e-c67d-4038-98c1-f6612d94921d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.575420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.576096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.576376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.576656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.577413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:33.577721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.579276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.587603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 283/572] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:33.588445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.604050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d21e-8259-4837-9a96-41338044eaef None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.638084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.638900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.639179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.639450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.646441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.647899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.661616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:33.662796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 290/573] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.663548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.686500 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ce8e1-bab3-4365-9a3d-c425d13b4939 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.718089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.718900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.719182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.719489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.726666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.728092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.741533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:33.742734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 284/574] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.743495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.758906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2be05-b29f-4580-9e7b-d6e3ddc2bfa4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.791879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.792715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.792947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.793218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.803325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:33.810219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:33.811429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 291/575] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.812192 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.838859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f280-011b-48a9-be5a-e3c6cf21d032 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.871635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.872420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.872701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.872973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.883166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.884611 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.901980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:33.903369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 285/576] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.903951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.907896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b51d4-8b9e-479f-bf0b-75d055131859 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:33.940434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:33.941213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:33.941491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:33.941762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:33.952164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:33.954180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:33.970567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:33.971755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 292/577] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:33.972596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:33.999792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c3361-474f-4481-8936-17ceb87006f6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.032779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.033432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.033716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.033993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.034812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.035121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.036551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.052268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 286/578] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.052268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.068144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cb453-a431-4dc2-8ed1-c9143c7fab7d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.099799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.100452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.100730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.101004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.101790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.102077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.103514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.115621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 293/579] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.116666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.149349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18913-7f8e-4428-8058-1991934b7190 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.181612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.182355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.182734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.183016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.183795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.184182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.185554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.193337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 287/580] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.194106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.208193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f3893-a1ac-47cc-85b5-ce9a634fa878 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.241505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.242152 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.242428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.242726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.243437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.243733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.245083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.255636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 294/581] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.256382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.287958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34797533-99d0-4b68-8f88-da04f82b8b52 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.319607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.320195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.320471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.320741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.321454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.321754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.323130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.334439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 288/582] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.335434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.350216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846edc2e-21fb-4dda-9060-16355ad0651f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.381795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.382687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.393612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.393612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/7e46af6e41bb45c08e5a6b9fd596e4f1/roles/4428e6eb6e55408d98a28a91a43b4935` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.397253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=7e46af6e41bb45c08e5a6b9fd596e4f1, role_id=4428e6eb6e55408d98a28a91a43b4935)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.398719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.429799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99f3d2-35f2-4e30-be1e-8b0c19e3ee10 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.462085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.462767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.463053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.463331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.464152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=f3b2e34e638041f7a5338c0d8ae1fa25) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.464465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.465868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.471119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 289/583] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/role_assignments?user.id=f3b2e34e638041f7a5338c0d8ae1fa25&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.471896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.486072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 295/584] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:34 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/7e46af6e41bb45c08e5a6b9fd596e4f1/roles/4428e6eb6e55408d98a28a91a43b4935 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:34.487257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.594951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4c857-3faa-4b20-ad8c-6dc1cd64096a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.617592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d75a-3471-4943-bc46-55218b0f4770 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.630699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.631623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.631983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.632333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.644730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.646340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.657633 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.658459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.658791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.659065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.665770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:34.667490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 290/585] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:34.667772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.668502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.669467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.685368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 31 17:53:34.691549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 296/586] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:34.692507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.772935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4984d0-0843-4f7c-ab43-0e025969cbf9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.795012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbddc3-701e-46bd-a71b-19c231ddf0e9 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.808166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.808977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.809321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.809532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.817663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.819163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.831898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.832868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.833367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.833839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.834220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 31 17:53:34.835023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.835626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 291/587] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:34.835998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.836235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.842051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.855195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 297/588] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.856330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.937601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe254-3eb6-4180-bc76-b839454435a2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.956790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5b950-6acd-48ee-90cd-f909cc691bf0 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:34.973336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.974013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.974295 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.974569 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.975467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.975779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.977203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:34.993366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:34.994332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:34.994845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:34.995152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 292/589] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:34.995543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:34.995980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:34.996865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:34.997371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:34.999067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.022680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 298/590] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:35.023836 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.097051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e71f-af94-4757-9295-9ce47fbf4191 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.129808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc9d62-b988-4fde-b504-544c9bbdb7bb None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.131349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.132184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.132476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.132751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.140017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.142449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.159992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 31 17:53:35.161554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 293/591] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:35.162469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.167894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.168993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.169472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.169953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.180514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.182227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.199796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:35.201282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 299/592] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:35.202237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.264992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fb57-1a76-43bf-b317-38c6a08e45f0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.301294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.302101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.302386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.302692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.304134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8bf53-efa1-46db-afe9-64b19ddf215a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.313434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.315412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.333839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:35.339878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 294/593] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:35.340261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.340758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.341393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.341871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.342338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.343412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:35.343920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.345980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.366982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 300/594] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:35.368137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.449152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283d62-74c4-4527-9aa1-06beca18635c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.471054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58a50-9993-4690-b9b0-77353967a807 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.483514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.484327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.484606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.484876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.486131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:35.486438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.488179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.499956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 295/595] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:35.500816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.509061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.510102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.510757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.511242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.512232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:35.512766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.514398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.526953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 301/596] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:35.528037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.609415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576b21f-927b-4049-8db3-01ee8b741d07 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.631502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93808e2-58fe-44d4-a84c-6bf89dd59044 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.643701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.644495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.644775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.645044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.655927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.657921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.668624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.669744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.670221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.670794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.675280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:35.676519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 296/597] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:35.677292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.679896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.681674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.697291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:35.699228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 302/598] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:35.700291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.780127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002b99a-4ac5-4674-a45d-84d7da57e073 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.804071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf94c3-7011-4f5e-af0e-d0f1277fd035 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.814904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.815911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.816354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.816767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.823978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.825647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.839341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:35.840038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.840925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.841412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.841948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.842899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:35.843436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.845660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.846163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 297/599] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:35.847028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.858424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 303/600] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:35.859637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.944195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47c9f-8583-41e5-a4e8-e32c0db6ff12 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.959397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01950-8ab2-4061-a843-63999b166139 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:35.978990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.979648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.979927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.980199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:35.980976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:35.981286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:35.982712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:35.994479 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 298/601] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:35.995296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:35.997368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:35.998445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:35.999000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:35.999472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:36.000499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:36.001030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:36.002941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:36.015896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 304/602] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:36.018195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:36.100130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d71c8-8ae3-41be-9614-1062452f8977 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:36.125010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbadde5-5e9a-499e-be3a-650e84bd4642 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:36.133131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:36.133928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:36.134208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:36.134481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:36.141825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:36.143470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:36.156973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:36.159348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 299/603] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:36.160113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:36.162667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:36.163722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:36.164145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:36.164573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/5bfec7fb739b42bfa2ddd682aa10dc95/roles/4428e6eb6e55408d98a28a91a43b4935` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:36.180126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=5bfec7fb739b42bfa2ddd682aa10dc95, role_id=4428e6eb6e55408d98a28a91a43b4935)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:36.181849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:36.256491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2eacb-2951-427c-890e-6a07810ca431 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:36.291062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 305/604] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:36 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/5bfec7fb739b42bfa2ddd682aa10dc95/roles/4428e6eb6e55408d98a28a91a43b4935 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:36.292054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:36.297040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:36.298599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:36.300850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:36.302960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/7436a3068f6545a4b74c877c5b8c81c3/roles/4428e6eb6e55408d98a28a91a43b4935` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:36.337490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=7436a3068f6545a4b74c877c5b8c81c3, role_id=4428e6eb6e55408d98a28a91a43b4935)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:36.342874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:36.437099 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4709d4c-5cc1-43c9-8ec8-267abcaed1aa None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:36.475982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87183d3-f647-4ecc-9d3c-b4f893151433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:36.477010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87183d3-f647-4ecc-9d3c-b4f893151433 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:36.480159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87183d3-f647-4ecc-9d3c-b4f893151433 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:36.484447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 300/605] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:36 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/7436a3068f6545a4b74c877c5b8c81c3/roles/4428e6eb6e55408d98a28a91a43b4935 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:36.484880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87183d3-f647-4ecc-9d3c-b4f893151433 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:36.486027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87183d3-f647-4ecc-9d3c-b4f893151433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:36.486539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87183d3-f647-4ecc-9d3c-b4f893151433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:36.488273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87183d3-f647-4ecc-9d3c-b4f893151433 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:36.503119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 306/606] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:36.508845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:36.669345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01865d7-9b49-4c84-9e4b-74ec4ca1135d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:36.709829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898f10-ff36-440f-b5b6-9c6bbb33b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:36.710832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898f10-ff36-440f-b5b6-9c6bbb33b6e0 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:36.711118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898f10-ff36-440f-b5b6-9c6bbb33b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:36.711391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898f10-ff36-440f-b5b6-9c6bbb33b6e0 None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/95559d1e48934be89e562208ff65d195/roles/4428e6eb6e55408d98a28a91a43b4935` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:36.727075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898f10-ff36-440f-b5b6-9c6bbb33b6e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=95559d1e48934be89e562208ff65d195, role_id=4428e6eb6e55408d98a28a91a43b4935)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:36.728517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898f10-ff36-440f-b5b6-9c6bbb33b6e0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:36.811823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 301/607] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:36 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/95559d1e48934be89e562208ff65d195/roles/4428e6eb6e55408d98a28a91a43b4935 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:37.018824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8fcb-1d95-46bc-b126-478c05ffa3a6 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.018824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8fcb-1d95-46bc-b126-478c05ffa3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.018824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8fcb-1d95-46bc-b126-478c05ffa3a6 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.019938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 307/608] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:37.025958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f7369-22d9-4850-82bc-2be01a554e47 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.026241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f7369-22d9-4850-82bc-2be01a554e47 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.026511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f7369-22d9-4850-82bc-2be01a554e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.049239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e17f7369-22d9-4850-82bc-2be01a554e47 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:37.050519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e17f7369-22d9-4850-82bc-2be01a554e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:37.140053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 302/609] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:37.167589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f7369-22d9-4850-82bc-2be01a554e47 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.167926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0a3b-d278-425b-b2db-dbe669d7f8b4 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.167926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0a3b-d278-425b-b2db-dbe669d7f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.167926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0a3b-d278-425b-b2db-dbe669d7f8b4 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.167926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 308/610] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:37.175015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83714b-614a-4b07-ab25-c63262bc0498 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.175303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83714b-614a-4b07-ab25-c63262bc0498 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.175583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83714b-614a-4b07-ab25-c63262bc0498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.196430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8e83714b-614a-4b07-ab25-c63262bc0498 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:37.197608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8e83714b-614a-4b07-ab25-c63262bc0498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:37.303911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 309/611] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:37.312864 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f7369-22d9-4850-82bc-2be01a554e47 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:37.327760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83714b-614a-4b07-ab25-c63262bc0498 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.350387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:37.351748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.352556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.353038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.367208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:37.377236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:37.383056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 303/612] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:37.386136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.432771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83714b-614a-4b07-ab25-c63262bc0498 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:37.470853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:37.471956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.471956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.472239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.482557 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:37.489898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:37.491692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 310/613] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:37.497346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.511365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a01d9-f206-4d51-b96c-a20f922c54a1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:37.552220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:37.553253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.553791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.554288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.555263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:37.555768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:37.557320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:37.582210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 304/614] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:37.587907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.601760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa1e3-ab9c-458d-9301-95677f157438 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:37.636139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:37.636807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.637087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.637362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.638107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:37.638410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:37.639879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:37.648977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 311/615] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:37.654323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.748001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f971-e7e5-47e7-abd3-039728771ffe None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:37.756905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b2d0d-3843-4e36-b2cb-289bfa14eba8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:37.791225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:37.792017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.792298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.792572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.795164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:37.795966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.796249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.796524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.804663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:37.806214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:37.821653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:37.823132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:37.825234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:37.827061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 312/616] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:37.833922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.854660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:37.862980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 305/617] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:37.863928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:37.940317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087fc6a-8567-4e55-9d85-2b8668a23659 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:37.974709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:37.977303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:37.977806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:37.978300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:37.979245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:37.979747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:37.981292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:37.994393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 313/618] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:38.000314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:38.018904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84954a-31ea-43d0-b34a-b363e50dd47b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.075339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:38.076018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:38.076297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:38.076570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:38.077302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:38.077608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:38.079103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:38.092231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 306/619] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:38.103592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:38.134525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cd51a-0c59-4b0f-a6e0-775a9f01db01 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.170272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:38.171437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:38.171988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:38.172456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:38.180905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:38.182584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:38.197721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:53:38.199684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 314/620] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:53:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:38.205457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:38.247719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17690-5ded-4d5a-9735-dce0895acab8 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.292786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:38.293450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:38.293731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:38.294004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] PATH_INFO: `/v3/users/swift` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:38.310757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4aff-eae4-403e-9522-ef3a1f87f230 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.311868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:38.313441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:38.336690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 31 17:53:38.338272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 307/621] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:38.343149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:38.348072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:38.349067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:38.349569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:38.350088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:38.351215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:38.351738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:38.353609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:38.374530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 315/622] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:53:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:38.380615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:38.484176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63059-98d2-41de-9278-15e28f7c86e3 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.524082 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:38.525939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:38.526451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:38.527102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:38.561294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f980-b6f8-4e30-bbe6-7b079c9d9bff None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.642167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:38.642864 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:38.643142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:38.643412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:38.644249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:38.644549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:38.645962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:38.662162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:38.663789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:38.692562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 308/623] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Mar 31 17:53:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:38.697345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:38.842867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 316/624] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 31 17:53:38.854927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:38.893562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d0e1-6583-412a-b27b-5ffb9082fe44 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.928532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:38.929700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:38.930211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:38.930734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:38.957762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:38.959296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:38.991983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21aca2-cae4-4bdd-b11c-776b6e094298 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:38.994272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:38.995842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 309/625] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:39.001416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.031255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.032100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.033579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.033867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.052458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.055997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.075642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:39.077524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 317/626] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:39.083243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.197134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a268d2-682d-43b6-b6f3-19a42ef5f4e3 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.242411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84945-0aa3-4b8f-bf40-542790549500 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.243251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300fc8d-6365-45b4-91e7-a7fcae9a6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.243926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300fc8d-6365-45b4-91e7-a7fcae9a6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.244208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300fc8d-6365-45b4-91e7-a7fcae9a6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.244483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300fc8d-6365-45b4-91e7-a7fcae9a6ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.245203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300fc8d-6365-45b4-91e7-a7fcae9a6ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:39.245508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300fc8d-6365-45b4-91e7-a7fcae9a6ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.247971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300fc8d-6365-45b4-91e7-a7fcae9a6ec3 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.262646 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 310/627] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:39.264167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894296ce-e4f5-445f-a4c6-0808a3869871 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.264458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894296ce-e4f5-445f-a4c6-0808a3869871 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.264896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894296ce-e4f5-445f-a4c6-0808a3869871 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.267945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 311/628] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:39.271376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894296ce-e4f5-445f-a4c6-0808a3869871 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.286793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06224aa0-593e-4d7e-911b-3a853b32bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.287838 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06224aa0-593e-4d7e-911b-3a853b32bbee None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.288342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06224aa0-593e-4d7e-911b-3a853b32bbee None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.288886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06224aa0-593e-4d7e-911b-3a853b32bbee None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.289810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06224aa0-593e-4d7e-911b-3a853b32bbee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:39.290336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06224aa0-593e-4d7e-911b-3a853b32bbee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.292001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06224aa0-593e-4d7e-911b-3a853b32bbee None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.304297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 318/629] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:39.305956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771a65-4f30-4369-a065-cf2376d7ef1e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.306449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771a65-4f30-4369-a065-cf2376d7ef1e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.306945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771a65-4f30-4369-a065-cf2376d7ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.324828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-50771a65-4f30-4369-a065-cf2376d7ef1e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:39.326329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-50771a65-4f30-4369-a065-cf2376d7ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:39.389593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894296ce-e4f5-445f-a4c6-0808a3869871 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.396002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 319/630] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:39.396665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771a65-4f30-4369-a065-cf2376d7ef1e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.441179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257fae-879a-4eeb-bf48-18feedab5f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.441979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257fae-879a-4eeb-bf48-18feedab5f0f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.442338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257fae-879a-4eeb-bf48-18feedab5f0f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.442641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257fae-879a-4eeb-bf48-18feedab5f0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.449529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257fae-879a-4eeb-bf48-18feedab5f0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.450920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257fae-879a-4eeb-bf48-18feedab5f0f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.464653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ab257fae-879a-4eeb-bf48-18feedab5f0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:39.465974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 312/631] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:39.467010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45da9d-1173-4fd7-9b84-76de2408ada9 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.467290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45da9d-1173-4fd7-9b84-76de2408ada9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.467560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45da9d-1173-4fd7-9b84-76de2408ada9 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.473234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 313/632] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:39.473234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45da9d-1173-4fd7-9b84-76de2408ada9 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.503896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771a65-4f30-4369-a065-cf2376d7ef1e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.538682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.539482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.539787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.540037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.546553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.548211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.561325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:39.567447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 320/633] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:39.567447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.577276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45da9d-1173-4fd7-9b84-76de2408ada9 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.611373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3dab4-8cad-4497-bb50-c3a009a7fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.612168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3dab4-8cad-4497-bb50-c3a009a7fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.612451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3dab4-8cad-4497-bb50-c3a009a7fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.612727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3dab4-8cad-4497-bb50-c3a009a7fbf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.623032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3dab4-8cad-4497-bb50-c3a009a7fbf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:39.630029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-6ea3dab4-8cad-4497-bb50-c3a009a7fbf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:39.631565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 314/634] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:39.632738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084eec-fb9c-4179-a670-39ed64725968 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.633025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084eec-fb9c-4179-a670-39ed64725968 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.633302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084eec-fb9c-4179-a670-39ed64725968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.650177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-45084eec-fb9c-4179-a670-39ed64725968 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:39.651393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-45084eec-fb9c-4179-a670-39ed64725968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:39.667572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51285436-e5c4-4775-ba0f-f1bf40a07c4d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.700463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.701044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.701323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.701594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.702370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:39.702710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.704153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.720514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 321/635] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:39.720683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 315/636] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:39.720683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084eec-fb9c-4179-a670-39ed64725968 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.720839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.816769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084eec-fb9c-4179-a670-39ed64725968 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.820123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ba143-7cec-42f9-8612-5fd5cae9ce10 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.848443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.849109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.849388 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.849663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.850414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:39.850755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.851674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.852117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.852317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.852594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.852875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.853641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:39.853941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:39.855362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:39.859837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 316/637] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:39.861314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.870552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 322/638] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:39.870552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:39.958270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d314-0a8a-4f24-9c68-28efee3e4bc1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.959637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c8d36-e169-43d9-ba16-9ecdfd046601 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:39.990212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.990759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df530ac-f594-4d12-a7bd-2ff3fc5c575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:39.991129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.991415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.991536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df530ac-f594-4d12-a7bd-2ff3fc5c575b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:39.991960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/f3b2e34e638041f7a5338c0d8ae1fa25/roles/4428e6eb6e55408d98a28a91a43b4935` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:39.993050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df530ac-f594-4d12-a7bd-2ff3fc5c575b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:39.993325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df530ac-f594-4d12-a7bd-2ff3fc5c575b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.003420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df530ac-f594-4d12-a7bd-2ff3fc5c575b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:40.006876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=f3b2e34e638041f7a5338c0d8ae1fa25, role_id=4428e6eb6e55408d98a28a91a43b4935)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.008305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.010157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-3df530ac-f594-4d12-a7bd-2ff3fc5c575b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:40.011502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 323/639] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:40.012514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe072df-8856-466c-94da-1d80ada561b0 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.012792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe072df-8856-466c-94da-1d80ada561b0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.013063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe072df-8856-466c-94da-1d80ada561b0 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.014737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 324/640] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:40.015412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe072df-8856-466c-94da-1d80ada561b0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.091045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 317/641] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:39 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/f3b2e34e638041f7a5338c0d8ae1fa25/roles/4428e6eb6e55408d98a28a91a43b4935 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:40.092144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.117034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe072df-8856-466c-94da-1d80ada561b0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.155084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.156373 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.157253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.157690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.172951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.174758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.195145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:40.200995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 325/642] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:40.200995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.202774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49d8cf-56ae-4b7a-99e5-bdb2869d059d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.239516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e706e-d942-4703-9395-3a4ba4892fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.240199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e706e-d942-4703-9395-3a4ba4892fc7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.240482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e706e-d942-4703-9395-3a4ba4892fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.240759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e706e-d942-4703-9395-3a4ba4892fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.241857 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e706e-d942-4703-9395-3a4ba4892fc7 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7e46af6e41bb45c08e5a6b9fd596e4f1) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:40.242178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e706e-d942-4703-9395-3a4ba4892fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.243652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e706e-d942-4703-9395-3a4ba4892fc7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.250315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 318/643] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/role_assignments?user.id=7e46af6e41bb45c08e5a6b9fd596e4f1&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:40.252353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06a2d-a904-42c0-95c5-1cf13e708957 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.252641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06a2d-a904-42c0-95c5-1cf13e708957 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.252915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06a2d-a904-42c0-95c5-1cf13e708957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.271890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b4c06a2d-a904-42c0-95c5-1cf13e708957 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:40.273136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b4c06a2d-a904-42c0-95c5-1cf13e708957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:40.335029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7afe7-a058-4338-9b89-7be5e4bdeac8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.357344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 319/644] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:40.358267 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06a2d-a904-42c0-95c5-1cf13e708957 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.372860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.373847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.374302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.374805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.375780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:40.376511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.378141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.387432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 326/645] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:40.394482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.487336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06a2d-a904-42c0-95c5-1cf13e708957 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.526422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659698e-e89d-43c0-9a2a-02936f622039 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.526596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.527044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.527325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.527600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.528322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:40.528631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.530011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.542948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 320/646] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:40.543964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.572332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.573435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.573904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.574361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.589441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.591234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.613632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:40.615999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 327/647] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:40.617291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.657168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf6e7-1d66-401a-9f0a-ff462ad193f2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.691242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.692049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.692331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.692604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.702917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:40.710558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:40.712088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 321/648] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:40.717067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.727931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0244-19ad-4d9e-a947-9e386d683c9c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.769308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.770414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.770926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.771387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.779724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.781380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.795816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 31 17:53:40.797604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 328/649] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:40.798640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.820486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a087cb-75f0-4178-be2c-d1acf9546a8a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.855249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.855871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.856152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.856426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.857142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:40.857448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.858839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.875573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 322/650] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:40.877185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.905205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d57a03-1203-4190-b056-2977793468e7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:40.941203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:40.942194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:40.942703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:40.943157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:40.944096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:40.944579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:40.946128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:40.959792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 329/651] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:40.960950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:40.976320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d7487-eef2-4579-98db-12ee8630f515 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.011310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.011991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.012275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.012554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.013697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:41.014010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.015471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.046723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 323/652] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:41.046723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.076539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a209a-6ea3-4d0c-aa91-e53e4fc0d3fa None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.111208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.112344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.112805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.113253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.124607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.126728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.144757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 31 17:53:41.146909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 330/653] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:41.147855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.168202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aad01-b0cf-4ed1-b288-f1c9f2688b2d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.202854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.203988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.204962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.205445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.216211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.217977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.237442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:41.242948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 324/654] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:41.243965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.257451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806bd1c-a853-4339-824a-b76ff810ccc5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.296095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.296803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.297029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.297315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.350751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9524b9-7ca4-4f67-a664-ff3fc49a7aee None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.366018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.367771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.389247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.390205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.390683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.391128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.397623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:41.397623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.397623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.413806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 325/655] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:41.415031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.474402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 331/656] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:41.474402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.521959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e86d-50ee-49cc-b7b2-0ed252afc571 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.569685 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.570812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.571333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.571813 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.572752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:41.573264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.574913 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.576922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a0b67-8659-4803-b368-ab8422696eb8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.592881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 326/657] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:41.594143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.613072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.613821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.614016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.614278 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.681709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.683199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.698414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5ac2d-20ca-4904-88a8-c6874033d82a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.735071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.736612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.737113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.737591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.748912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.750685 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.769192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:41.778869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 327/658] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:41.779989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.786070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 332/659] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:41.787763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.885886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a7dab-a382-4757-9f13-2f9e3d04e388 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.886062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba415b9-6c99-4056-8205-b01107d16ea9 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:41.921019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.921524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:41.921672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.921950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.922225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.923581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:41.923899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:41.924001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.924517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:41.924998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:41.925329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.933490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:41.935316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:41.942095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 333/660] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:41.943004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:41.949930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 31 17:53:41.951665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 328/661] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:41.957479 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.045957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e138ee-126e-4eda-aa60-5a8a192c0026 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.068375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762fc51-4d0c-44b6-a646-166751bfb64a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.083134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.083956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.084237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.084513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.096617 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.098025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.115688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.116549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:42.117299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.117785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.118287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.118489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 334/662] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:42.119387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.126748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.128555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.143838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:42.145364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 329/663] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:42.146317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.221570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0d441-ddff-4301-97fb-14b6b6c3f5d5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.248011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfabce-e6e8-4c1f-a1b8-30926b629afe None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.255836 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.256678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.256792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.257055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.257889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:42.258200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.259653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.277821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 335/664] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:42.278755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.286227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.286938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.287220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.287497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.288252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:42.289047 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.290428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.304976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 330/665] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:42.306224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.389789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908230aa-0a81-42d1-892f-e173385f587a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.425990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.426706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.434868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.434868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.434868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:42.434868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.434868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.435264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12988be9-64ae-4068-904b-d07e48fac81d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.444896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 336/666] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:42.445936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.471736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dfc69-7302-40cd-af33-448ec04977d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.472394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dfc69-7302-40cd-af33-448ec04977d8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.472695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dfc69-7302-40cd-af33-448ec04977d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.472944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dfc69-7302-40cd-af33-448ec04977d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.543897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dfc69-7302-40cd-af33-448ec04977d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.545343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dfc69-7302-40cd-af33-448ec04977d8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.549964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa159a2-6e4c-40ee-a9b4-057a976eb635 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.588260 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.589065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.589345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.589618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.596771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.598206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.612512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:42.613940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 337/667] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:42.614927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.647172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 331/668] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:42.648823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f61e-6bd4-4c6b-8a7d-a8a8946383bf None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.649181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f61e-6bd4-4c6b-8a7d-a8a8946383bf None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.649528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f61e-6bd4-4c6b-8a7d-a8a8946383bf None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.652765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 332/669] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:42.653627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f61e-6bd4-4c6b-8a7d-a8a8946383bf None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.717653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7c56f-b120-4dc7-b135-66db12eef987 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.750499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.751243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.751523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.751799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.752626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7436a3068f6545a4b74c877c5b8c81c3) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:42.752934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.754349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.757904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f61e-6bd4-4c6b-8a7d-a8a8946383bf None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.760516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 338/670] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/role_assignments?user.id=7436a3068f6545a4b74c877c5b8c81c3&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:42.761380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.800812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc191cb-c6c4-4e68-abb3-984336997fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.801884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc191cb-c6c4-4e68-abb3-984336997fcf None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.802374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc191cb-c6c4-4e68-abb3-984336997fcf None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.803029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc191cb-c6c4-4e68-abb3-984336997fcf None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.804068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc191cb-c6c4-4e68-abb3-984336997fcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:42.804598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc191cb-c6c4-4e68-abb3-984336997fcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.806286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc191cb-c6c4-4e68-abb3-984336997fcf None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.819995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 333/671] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:42.821623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7283a-b81d-4497-90cc-a6d0264242c6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.822094 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7283a-b81d-4497-90cc-a6d0264242c6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.822524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7283a-b81d-4497-90cc-a6d0264242c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.840244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-91e7283a-b81d-4497-90cc-a6d0264242c6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:42.841482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-91e7283a-b81d-4497-90cc-a6d0264242c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:42.874150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88620ebc-935a-424c-a7fe-e36729b359c6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:42.911565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 334/672] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:42.911762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554530dc-326d-4702-8394-5fed8389617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:42.912499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530dc-326d-4702-8394-5fed8389617e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.912744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34511956-42f2-4bed-9ffd-970becdf333e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.912865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530dc-326d-4702-8394-5fed8389617e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.913041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34511956-42f2-4bed-9ffd-970becdf333e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.913251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530dc-326d-4702-8394-5fed8389617e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.913380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34511956-42f2-4bed-9ffd-970becdf333e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.915411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 335/673] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:42.916132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34511956-42f2-4bed-9ffd-970becdf333e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:42.935639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554530dc-326d-4702-8394-5fed8389617e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:42.937113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554530dc-326d-4702-8394-5fed8389617e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:42.955643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-554530dc-326d-4702-8394-5fed8389617e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:42.957208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 339/674] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:42.958502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd97d-b07a-4c44-bce7-0ab496ee3fed None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:42.958813 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd97d-b07a-4c44-bce7-0ab496ee3fed None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:42.959815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd97d-b07a-4c44-bce7-0ab496ee3fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:42.979735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-60ffd97d-b07a-4c44-bce7-0ab496ee3fed None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:42.980867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-60ffd97d-b07a-4c44-bce7-0ab496ee3fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:43.029236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34511956-42f2-4bed-9ffd-970becdf333e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.066100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.066875 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.074673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.074814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 340/675] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:43.074925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.075011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffd97d-b07a-4c44-bce7-0ab496ee3fed None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.075091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=5bfec7fb739b42bfa2ddd682aa10dc95) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:43.075091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.075091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.077594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 336/676] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:42 2022] GET /identity/v3/role_assignments?user.id=5bfec7fb739b42bfa2ddd682aa10dc95&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:43.078458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.193408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffd97d-b07a-4c44-bce7-0ab496ee3fed None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.203891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337efaa4-c219-41cc-9107-b0b758691436 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.230697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.231953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.232452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.232930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.244248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.245226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.245536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.245828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.246535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:43.246811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:43.246929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.248293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.255295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:43.256844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 341/677] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:43.257884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.267807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 337/678] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:43.268785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.384506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68be1-9bfb-4272-9af5-2e83734731ea None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.389998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1ae9-c764-4943-aa50-cb3c25f86d9d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.419688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.420483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.420768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.421166 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.432334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:43.434419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.435134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.435419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.435927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.436476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:43.436779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.438287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.446313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:43.447184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 338/679] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:43.447838 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 342/680] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:43.448055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.458634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.558431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e6f4f-db86-4815-beb6-78bd193a057c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.575239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa39d8-8a7e-4372-9025-7ac090891595 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.592196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.593182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.593462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.593733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.604426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.605947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.615715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.616631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.617167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.617448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.623757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:43.624275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.625703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.629827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 343/681] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:43.630704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.640326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:43.646867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 339/682] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:43.647735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.745829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb9d5f-a496-49fe-ab47-149dcb368e61 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.752545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c0489-6d80-4f41-8b36-687ddc9ebf93 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.780231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.780892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.781170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.781442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.782155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:43.783181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.785645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.793387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.794056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.794788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.795063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.796082 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:43.796384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.797724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.802321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 340/683] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:43.803217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.808003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 344/684] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:43.808847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.911570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d23ec-553c-424f-955b-2828c5dc47c9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.915906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff24e-f65a-4078-91de-a8210c02169f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:43.945968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.946650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.946940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.947223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.948010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:43.948357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.949861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.950177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:43.951007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:43.951288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:43.951558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] PATH_INFO: `/v3/users/swift` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:43.959652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:43.961089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:43.963031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 341/685] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:43.963968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:43.980698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 31 17:53:43.981896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 345/686] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:43.987324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.082419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb03d-4f1d-4fb9-8616-acc294fa8d5a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.091204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925cf7-81f0-48d7-8b39-322de79cdbed None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.119162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.120292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.120758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.121173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.125447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.126129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.126601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.126935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.127726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=95559d1e48934be89e562208ff65d195) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:44.128039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.129440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.132899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.134490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.142252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 346/687] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/role_assignments?user.id=95559d1e48934be89e562208ff65d195&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:44.142252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.166448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:44.175169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 342/688] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:44.180989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.240574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbda1ea-22e2-43bc-a57e-ad13257d5cdc None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.307445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.308152 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.308438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.308719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.309579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:44.309909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.311461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.317893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3bff-4767-4354-af30-1aa88f9e409c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.350766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 347/689] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:44.359351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.369256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.369937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.370223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.370494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.371252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:44.371559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.372936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.399740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 343/690] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:44.403649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.493458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6101a-b22b-40d9-b9c0-33e052e8b9ce None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.527187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.527839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.528113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.528384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.536123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d440143-a456-45bc-9e82-492b5f192a0f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.569629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.570346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.570650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.570932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.578586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.580100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.593425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:53:44.595440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 344/691] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:44.603589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.603949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.605392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.706936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 348/692] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:44.710022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4ac69-38bc-40b7-93f0-5e41cddc1333 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.712381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.748989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.749581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.749861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.750134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.751003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:44.751988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.753491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.772410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 345/693] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:44.778100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:44.836568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a72676-01e7-4d9f-9bc0-c56b4685b1c6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.889767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ee00-6dd2-4e91-92f6-a75e281381d3 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:44.892798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.893537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.893810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.894079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.919090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:44.920592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:44.950206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:44.959029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:44.959702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:44.959984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:44.960260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:44.962144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 349/694] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:44.967909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.092290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.093671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.174345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1e6fc-d8ba-4cf4-b9f2-e8c3aba48afe None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:45.240544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:45.241216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.241499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.241776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.242936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:45.243255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.247339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.268933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 350/695] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:45.272177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.288428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 346/696] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:45.295652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.407231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cc0fe-1a27-4c42-970b-f8b035ac04c0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:45.440227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05199a9-aaf1-420e-91a9-0ced5497b566 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:45.452777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4766f-615a-4e23-add8-dce2078fcb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:45.453603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4766f-615a-4e23-add8-dce2078fcb34 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.453882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4766f-615a-4e23-add8-dce2078fcb34 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.454384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4766f-615a-4e23-add8-dce2078fcb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.467205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4766f-615a-4e23-add8-dce2078fcb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.469250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4766f-615a-4e23-add8-dce2078fcb34 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.476350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306dcd9-fcc4-482c-8b97-0c1b80a32c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:45.477230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306dcd9-fcc4-482c-8b97-0c1b80a32c61 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.477655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306dcd9-fcc4-482c-8b97-0c1b80a32c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.478004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306dcd9-fcc4-482c-8b97-0c1b80a32c61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.485174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306dcd9-fcc4-482c-8b97-0c1b80a32c61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.488028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306dcd9-fcc4-482c-8b97-0c1b80a32c61 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.490213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-5cc4766f-615a-4e23-add8-dce2078fcb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:45.494772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 347/697] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:45.496084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d14f-e11b-4696-9de8-cb18db9f060e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.496374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d14f-e11b-4696-9de8-cb18db9f060e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.496650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d14f-e11b-4696-9de8-cb18db9f060e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.498697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 348/698] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:45.499416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6d14f-e11b-4696-9de8-cb18db9f060e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.510345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-8306dcd9-fcc4-482c-8b97-0c1b80a32c61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:45.511875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 351/699] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:45.513084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62420e-0e61-4057-9c97-90e482dcc8fd None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.513371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62420e-0e61-4057-9c97-90e482dcc8fd None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.513651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62420e-0e61-4057-9c97-90e482dcc8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.531458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9b62420e-0e61-4057-9c97-90e482dcc8fd None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:45.533253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9b62420e-0e61-4057-9c97-90e482dcc8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:45.603071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 352/700] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:45.603985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62420e-0e61-4057-9c97-90e482dcc8fd None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.639828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6d14f-e11b-4696-9de8-cb18db9f060e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:45.683780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:45.684858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.685277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.685674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.686404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:45.686729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.689264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.706791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 349/701] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:45.708713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.722320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62420e-0e61-4057-9c97-90e482dcc8fd None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:45.764072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:45.764732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.765013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.765282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.766061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:45.766364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.768491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.779810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 353/702] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:45.780603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.815385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040c9e-12ef-4bbb-9309-adc581f59da4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:45.847936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd9c26-376f-4ce4-8957-ebebbe12f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:45.848752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9c26-376f-4ce4-8957-ebebbe12f62f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.849004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9c26-376f-4ce4-8957-ebebbe12f62f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.849274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9c26-376f-4ce4-8957-ebebbe12f62f None admin] PATH_INFO: `/v3/services/network` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.849918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd9c26-376f-4ce4-8957-ebebbe12f62f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.851292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd9c26-376f-4ce4-8957-ebebbe12f62f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.864447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b2dd9c26-376f-4ce4-8957-ebebbe12f62f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 31 17:53:45.870642 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 350/703] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:45.871901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a53f-e000-4cfe-8ecb-7616652cbfd7 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.872185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a53f-e000-4cfe-8ecb-7616652cbfd7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.872457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a53f-e000-4cfe-8ecb-7616652cbfd7 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.874644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 351/704] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:45.875097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a53f-e000-4cfe-8ecb-7616652cbfd7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.884714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ae65d-f34c-42ff-90f3-de3b96b1efca None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:45.919247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:45.920042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:45.920326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:45.920609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:45.927548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:45.928993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:45.942669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:45.943788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 354/705] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:45.944561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:45.985516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a53f-e000-4cfe-8ecb-7616652cbfd7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.019940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848347-4385-493e-9d0a-10e001bdd481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.020591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848347-4385-493e-9d0a-10e001bdd481 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.020870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848347-4385-493e-9d0a-10e001bdd481 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.021143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848347-4385-493e-9d0a-10e001bdd481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.021961 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848347-4385-493e-9d0a-10e001bdd481 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=f3b2e34e638041f7a5338c0d8ae1fa25) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:46.022268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848347-4385-493e-9d0a-10e001bdd481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.023723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848347-4385-493e-9d0a-10e001bdd481 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.034837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 352/706] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/role_assignments?user.id=f3b2e34e638041f7a5338c0d8ae1fa25&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:46.034837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a004-4676-43d5-b5c6-3d0e5e965acf None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.034837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a004-4676-43d5-b5c6-3d0e5e965acf None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.034837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a004-4676-43d5-b5c6-3d0e5e965acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.051889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a284a004-4676-43d5-b5c6-3d0e5e965acf None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:46.053146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a284a004-4676-43d5-b5c6-3d0e5e965acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:46.057674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b36f7-4896-4506-aeb8-4b0abf64303f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.106765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.107717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.107998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.108270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.109159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] RBAC: Adding query filter params (name=network) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:46.109821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.111425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.118520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 355/707] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:53:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:46.119439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:46.139107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 353/708] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:46.140154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a004-4676-43d5-b5c6-3d0e5e965acf None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:46.242887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725098-a8f0-4c64-beed-802fa4e0121c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.279962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.280170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a004-4676-43d5-b5c6-3d0e5e965acf None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.280621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.280899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.281172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.281949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:46.283487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.284727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.297193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 356/709] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:46.297899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:46.321955 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.322660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.322957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.323233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.323946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] RBAC: Adding query filter params (type=network) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:46.324257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.325632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.332042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 354/710] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:53:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:46.332638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:46.420484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081fb8-912b-4547-a4c1-bff083e6db25 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.451544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42015-fb0a-4a04-81b6-84ecb88a7ec2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.457273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.458074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.458407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.458715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.469857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.471486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.491226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:46.497361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 357/711] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:46.497499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.497499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.497499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.497499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.498327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7e46af6e41bb45c08e5a6b9fd596e4f1) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:46.498327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.499240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:46.500742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.516621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 355/712] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:46 2022] GET /identity/v3/role_assignments?user.id=7e46af6e41bb45c08e5a6b9fd596e4f1&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:46.621192 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2256f9d-56c4-4b21-9246-93dd480ca589 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.663199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe15a98-2f2f-4048-bba9-a3835b93c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.663892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15a98-2f2f-4048-bba9-a3835b93c6cc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.664174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15a98-2f2f-4048-bba9-a3835b93c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.664451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15a98-2f2f-4048-bba9-a3835b93c6cc None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.665201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15a98-2f2f-4048-bba9-a3835b93c6cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:46.665511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15a98-2f2f-4048-bba9-a3835b93c6cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.666977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15a98-2f2f-4048-bba9-a3835b93c6cc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.683892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 358/713] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:46.690455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:46.802546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d034-7157-483e-ab24-8def93bcde5b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:46.841189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de75d3-204c-43c7-bfab-d4cb4adde30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:46.841869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de75d3-204c-43c7-bfab-d4cb4adde30b None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:46.842149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de75d3-204c-43c7-bfab-d4cb4adde30b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:46.842421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de75d3-204c-43c7-bfab-d4cb4adde30b None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:46.843157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de75d3-204c-43c7-bfab-d4cb4adde30b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:46.844578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de75d3-204c-43c7-bfab-d4cb4adde30b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:46.931183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 356/714] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:53:46 2022] POST /identity/v3/users => generated 254 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:47.065915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08aa8d-0984-400c-80a6-db9c894b9d55 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:47.066214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08aa8d-0984-400c-80a6-db9c894b9d55 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:47.066470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08aa8d-0984-400c-80a6-db9c894b9d55 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:47.068764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 359/715] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:47.074053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9834ab-1527-4845-854a-da8bf86a45e8 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:47.074348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9834ab-1527-4845-854a-da8bf86a45e8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:47.074647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9834ab-1527-4845-854a-da8bf86a45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:47.100929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0c9834ab-1527-4845-854a-da8bf86a45e8 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:47.102140 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0c9834ab-1527-4845-854a-da8bf86a45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:47.195611 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 357/716] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:47.220516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08aa8d-0984-400c-80a6-db9c894b9d55 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:47.329944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08aa8d-0984-400c-80a6-db9c894b9d55 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:47.365606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:47.366426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:47.366730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:47.367000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:47.367913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:47.369267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:47.385986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 31 17:53:47.387510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 360/717] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Mar 31 17:53:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:47.393963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9834ab-1527-4845-854a-da8bf86a45e8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:47.504482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9834ab-1527-4845-854a-da8bf86a45e8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:47.542119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9235f-9330-4eca-90b8-9ba8d8cb1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:47.542819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9235f-9330-4eca-90b8-9ba8d8cb1689 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:47.543101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9235f-9330-4eca-90b8-9ba8d8cb1689 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:47.543376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9235f-9330-4eca-90b8-9ba8d8cb1689 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:47.544153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9235f-9330-4eca-90b8-9ba8d8cb1689 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:47.544462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9235f-9330-4eca-90b8-9ba8d8cb1689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:47.545836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9235f-9330-4eca-90b8-9ba8d8cb1689 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:47.551446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 358/718] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Mar 31 17:53:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:47.556877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:47.686626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625d14c-b79d-44d5-9fe7-f59457f60de1 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:47.726006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ea71a-0c1c-46d6-a320-c91ced6513bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:47.726703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ea71a-0c1c-46d6-a320-c91ced6513bd None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:47.726990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ea71a-0c1c-46d6-a320-c91ced6513bd None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:47.727265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ea71a-0c1c-46d6-a320-c91ced6513bd None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:47.727982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ea71a-0c1c-46d6-a320-c91ced6513bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:47.728286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ea71a-0c1c-46d6-a320-c91ced6513bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:47.729664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ea71a-0c1c-46d6-a320-c91ced6513bd None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:47.736365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 361/719] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Mar 31 17:53:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:48.991130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a5758-297e-4b6e-9d42-bd64bdf26702 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:48.992157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a5758-297e-4b6e-9d42-bd64bdf26702 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:48.992897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a5758-297e-4b6e-9d42-bd64bdf26702 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:48.995346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 359/720] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:49.001079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94f86-272b-4663-83de-3a8d08133984 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.002007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94f86-272b-4663-83de-3a8d08133984 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.002506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94f86-272b-4663-83de-3a8d08133984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.027587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-49e94f86-272b-4663-83de-3a8d08133984 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:49.029133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-49e94f86-272b-4663-83de-3a8d08133984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:49.134970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 362/721] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:49.166199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a5758-297e-4b6e-9d42-bd64bdf26702 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:49.209265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbdd0-eeeb-418b-aaf5-c18d8dad0c9b None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.209898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbdd0-eeeb-418b-aaf5-c18d8dad0c9b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.210394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cbdd0-eeeb-418b-aaf5-c18d8dad0c9b None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.212399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 363/722] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:49.217416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e639a-962c-48e1-951d-95ff3ea73f3e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.217953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e639a-962c-48e1-951d-95ff3ea73f3e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.218429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e639a-962c-48e1-951d-95ff3ea73f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.241890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-864e639a-962c-48e1-951d-95ff3ea73f3e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:49.243958 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-864e639a-962c-48e1-951d-95ff3ea73f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:49.309578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a5758-297e-4b6e-9d42-bd64bdf26702 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:49.334705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 364/723] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:49.336529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe7ee-7bd8-4dcc-8790-409cd2128e3c None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.337018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe7ee-7bd8-4dcc-8790-409cd2128e3c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.337514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe7ee-7bd8-4dcc-8790-409cd2128e3c None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.343209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 365/724] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:49.355664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a2b1-50a0-453b-be6d-42f8d294f471 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.356317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a2b1-50a0-453b-be6d-42f8d294f471 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.356793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a2b1-50a0-453b-be6d-42f8d294f471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.363268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:49.365175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.367029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.367367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.376723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-5573a2b1-50a0-453b-be6d-42f8d294f471 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:49.378320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5573a2b1-50a0-453b-be6d-42f8d294f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:49.380079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:49.388536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:49.394721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 360/725] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:49.394721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:49.459426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 366/726] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 31 17:53:49.460378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573a2b1-50a0-453b-be6d-42f8d294f471 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:49.524840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a47ed-4edf-498e-b1c5-5fd21bfa0ff0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:49.559897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:49.560775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.561157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.561563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.562389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:49.564002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:49.571442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573a2b1-50a0-453b-be6d-42f8d294f471 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:49.604754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:49.605438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.605768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.606042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.606806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:49.607108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:49.608455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:49.621581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 367/727] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:49.621581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:49.658871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 361/728] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:53:49 2022] POST /identity/v3/services => generated 240 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:49.659809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:49.745334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016585-e716-4b59-920f-cf694cd8f94f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:49.801400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:49.802622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.803595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.804069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:49.817683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:49.826183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:49.833165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 368/729] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:49.835355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:49.950797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aaa30-4809-4b90-8801-f8388f2e354b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:49.957698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524179b9-de43-4c76-9a53-8afc7863c1f9 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:49.988547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:49.989353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:49.989633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:49.989907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.000397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.001291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.002740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.003507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.004023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.004240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.005400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:50.005901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.007523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.021233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 369/730] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:50.021989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:50.023057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.023492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 362/731] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:50.041385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.140844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b61385-105a-4188-a6a4-827f4bee9d2f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.146096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd93b8-078c-4d3e-b6cd-a2b6f632cad1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.182934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664d302-e16f-4a00-890b-de7af66c083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.183627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d302-e16f-4a00-890b-de7af66c083d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.183928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d302-e16f-4a00-890b-de7af66c083d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.184190 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664d302-e16f-4a00-890b-de7af66c083d None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.184948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664d302-e16f-4a00-890b-de7af66c083d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:50.185240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b7b6-de04-402e-9751-27b75491ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.185369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664d302-e16f-4a00-890b-de7af66c083d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.186368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b7b6-de04-402e-9751-27b75491ca08 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.186680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664d302-e16f-4a00-890b-de7af66c083d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.187118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b7b6-de04-402e-9751-27b75491ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.187585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b7b6-de04-402e-9751-27b75491ca08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.201083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b7b6-de04-402e-9751-27b75491ca08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.202264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 363/732] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:50.203405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b7b6-de04-402e-9751-27b75491ca08 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.203753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e39d8-c836-4b0a-802c-afe95d19b130 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.204051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e39d8-c836-4b0a-802c-afe95d19b130 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.204334 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e39d8-c836-4b0a-802c-afe95d19b130 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.210927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 364/733] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:50.211880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e39d8-c836-4b0a-802c-afe95d19b130 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.223975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-a6e4b7b6-de04-402e-9751-27b75491ca08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:50.230348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 370/734] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:50.231912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41dd17-eea7-4e79-8212-46fe6696a9d8 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.232421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41dd17-eea7-4e79-8212-46fe6696a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.232893 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41dd17-eea7-4e79-8212-46fe6696a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.252279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2a41dd17-eea7-4e79-8212-46fe6696a9d8 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:50.253850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2a41dd17-eea7-4e79-8212-46fe6696a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:50.317648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e39d8-c836-4b0a-802c-afe95d19b130 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.323420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 371/735] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:50 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:50.324487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41dd17-eea7-4e79-8212-46fe6696a9d8 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.375083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.375886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.376170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.376538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.384655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.386446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.402042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 31 17:53:50.403171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 365/736] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:50.403962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.446871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41dd17-eea7-4e79-8212-46fe6696a9d8 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.481974 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.482662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.482950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.483227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.484051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:50.484580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.485710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.503482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 372/737] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:50.503482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.516897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804fc14-ab5f-4bbd-bc93-15b26654fbd6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.552738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.554012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.554491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.556070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.566622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:50.573700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:50.578828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 366/738] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:50.578828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.606215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a98ad1-0a6a-4e20-9f0d-697d2fd33f78 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.639792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770b140-3bce-4a19-8097-2e0f168941c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.640460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770b140-3bce-4a19-8097-2e0f168941c7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.640738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770b140-3bce-4a19-8097-2e0f168941c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.641010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770b140-3bce-4a19-8097-2e0f168941c7 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.641832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770b140-3bce-4a19-8097-2e0f168941c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:50.642188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770b140-3bce-4a19-8097-2e0f168941c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.643685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770b140-3bce-4a19-8097-2e0f168941c7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.665325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 373/739] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:50.665325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5852fd-e946-40b5-9a23-00f90adda8bb None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.665325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5852fd-e946-40b5-9a23-00f90adda8bb None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.665325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5852fd-e946-40b5-9a23-00f90adda8bb None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.665325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 374/740] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:50.665325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5852fd-e946-40b5-9a23-00f90adda8bb None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.680650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a5f47-a96e-47c2-83d5-4bbf894f4c5d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.714740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.715533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.715815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.716089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.724596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.726148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.740341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:53:50.746151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 367/741] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:50.746151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.771972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5852fd-e946-40b5-9a23-00f90adda8bb None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.806345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b8325-a08d-4ca9-a9e7-16e148569827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.807040 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8325-a08d-4ca9-a9e7-16e148569827 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.807318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8325-a08d-4ca9-a9e7-16e148569827 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.807591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8325-a08d-4ca9-a9e7-16e148569827 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.808329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8325-a08d-4ca9-a9e7-16e148569827 None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:50.808629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8325-a08d-4ca9-a9e7-16e148569827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.809991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8325-a08d-4ca9-a9e7-16e148569827 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:50.823176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 375/742] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:50.823176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83c1c-abd7-43b4-8aca-401c66f0402a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.823176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83c1c-abd7-43b4-8aca-401c66f0402a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.823176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83c1c-abd7-43b4-8aca-401c66f0402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.838325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-59b83c1c-abd7-43b4-8aca-401c66f0402a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:50.839446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-59b83c1c-abd7-43b4-8aca-401c66f0402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:50.853146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452bed3-78c0-440f-beab-637e5c6bc449 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:50.886889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:50.887544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:50.887835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:50.888115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:50.914632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 376/743] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:50 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 31 17:53:50.914632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b83c1c-abd7-43b4-8aca-401c66f0402a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:50.967644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:50.969110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.018515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b83c1c-abd7-43b4-8aca-401c66f0402a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.052687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.053362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.053636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.053904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.054768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:51.055075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.056493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.071578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 368/744] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 31 17:53:51.073236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.078427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 377/745] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:53:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:51.078427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.179384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88013cb-a349-4ca7-a997-4cb560384825 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.183450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836d8f5-b4d7-4d32-9443-d3439f18efea None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.213147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.213943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.214223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.214496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.217072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.217730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.218011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.218292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.219044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.221056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.226881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.228323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.245196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:51.246470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 369/746] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:51.247261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.303111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 378/747] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:53:51 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:51.304274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.348665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a2803-1aa9-4d3f-9697-b85a5f9233c4 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.399481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.400671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.401160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.401656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.413914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.415802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.423225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c5a4-262b-4088-88b7-44446005fe6f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.434786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:51.436679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 370/748] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:51.437717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.473948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.475688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.475688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.475688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.489505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.491008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.510707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:51.510707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 379/749] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:51.511891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.563068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083588-d53c-4da2-ab70-bc3257b4f2c7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.601497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.602164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.602446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.602755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.603481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:51.603836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.605225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.618840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 371/750] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:51.619753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.639096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a4be0-c0e6-433e-b9b2-de1a481983b7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.681916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.683425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.683892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.684335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.685283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:51.685939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.687704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.706044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 380/751] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:51.707453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.729728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166720-d4f4-4cf7-9663-d35711ca37cd None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.772680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.773352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.773632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.773902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.774635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:51.775382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.777054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.792155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 372/752] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:51.793104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.836883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87acc70-0b26-449a-ac7a-acdec028ee1f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.877851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.878693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.878975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.879246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.888733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.890634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.906833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6743cc-0db6-418f-af46-1a315ae5bc10 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:51.910147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 31 17:53:51.911819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 381/753] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:51.912714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:51.955841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:51.956557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:51.956836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:51.957109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:51.967069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:51.968602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:51.984111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:51.985738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 373/754] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:51.987266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.029667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b227-651a-4ccc-bc6a-e79377ee6bd5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.065875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.066211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.066487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.066804 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.073744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.075235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.088471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:52.094696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 382/755] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:52.094696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.107670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115a6fc-867b-44a2-94ea-d5a458109d39 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.143874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.144795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.145224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.145639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.146690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:52.147141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.148715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.167341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 374/756] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Mar 31 17:53:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:52.168379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.197571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85cc1-7f7f-4a43-b1f3-9b8f0dbafa35 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.231271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.231928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.232209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.232486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.233256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:52.233560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.235125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.253481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 383/757] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:52.254409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.275138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f538c2-c1aa-4bff-b741-afe9a3ad569d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.309531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.310202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.310483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.310789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.311571 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:52.311878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.313283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.326732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 375/758] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:52.326732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.356650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bec8d-b199-481d-aa02-85705b509e31 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.390262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4abc3-7cf3-480f-82e8-89e7b245cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.390937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4abc3-7cf3-480f-82e8-89e7b245cb51 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.397883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4abc3-7cf3-480f-82e8-89e7b245cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.397883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4abc3-7cf3-480f-82e8-89e7b245cb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.423809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc6c90-403b-447b-9847-02b1e1c4c87c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.457301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344d8e0-745a-4c8f-a0d8-80de37ff1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.457964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344d8e0-745a-4c8f-a0d8-80de37ff1c52 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.458251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344d8e0-745a-4c8f-a0d8-80de37ff1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.458524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344d8e0-745a-4c8f-a0d8-80de37ff1c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.459398 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344d8e0-745a-4c8f-a0d8-80de37ff1c52 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=f3b2e34e638041f7a5338c0d8ae1fa25) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:52.459714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344d8e0-745a-4c8f-a0d8-80de37ff1c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.461136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344d8e0-745a-4c8f-a0d8-80de37ff1c52 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.466291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4abc3-7cf3-480f-82e8-89e7b245cb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.466841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 376/759] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/role_assignments?user.id=f3b2e34e638041f7a5338c0d8ae1fa25&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:52.467940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242848-6ad1-43cc-b374-6f0d4aa005b5 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.468233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242848-6ad1-43cc-b374-6f0d4aa005b5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.468512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242848-6ad1-43cc-b374-6f0d4aa005b5 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.474892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 377/760] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:52.474892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242848-6ad1-43cc-b374-6f0d4aa005b5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.475152 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4abc3-7cf3-480f-82e8-89e7b245cb51 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.592291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242848-6ad1-43cc-b374-6f0d4aa005b5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.592632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 384/761] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:53:52.594135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24130a-80aa-47f2-b76e-29c62cd5ad4f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.594639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24130a-80aa-47f2-b76e-29c62cd5ad4f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.595141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24130a-80aa-47f2-b76e-29c62cd5ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.613220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-fd24130a-80aa-47f2-b76e-29c62cd5ad4f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:52.614856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-fd24130a-80aa-47f2-b76e-29c62cd5ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:52.631359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.632253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.632617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.632894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/7e46af6e41bb45c08e5a6b9fd596e4f1/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.635164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=7e46af6e41bb45c08e5a6b9fd596e4f1, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.636756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.688354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 385/762] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:53:52.690097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24130a-80aa-47f2-b76e-29c62cd5ad4f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.725097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 378/763] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:52 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/7e46af6e41bb45c08e5a6b9fd596e4f1/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:52.726357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.814800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24130a-80aa-47f2-b76e-29c62cd5ad4f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.858555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2d87-bb61-47c0-b266-22d6e3bd0d6b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:52.859485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.860449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.861693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.861972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.874643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.877467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.897498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:52.898307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:52.898415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:52.898587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:52.898908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] PATH_INFO: `/v3/services/network` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:52.899576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:52.901049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:52.904483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 386/764] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:52.906126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:52.916693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 31 17:53:52.918280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 379/765] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:52.925726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:53.048462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94970448-27d2-4912-9cb5-69e3a5abe231 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.085069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.085930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.086210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.086482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.087528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:53.087834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.089183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:53.108010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 387/766] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:53.109645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:53.120558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71a398-3bf7-4b02-905e-298618bc9390 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.212277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.212962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.213245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.213518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.214238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:53.214542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.215936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:53.217451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd0dfd-5778-448c-a810-35321e8b0498 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.228927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 380/767] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:53:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:53.247780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:53.258562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.259449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.259727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.260001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.269248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.270771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:53.287430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:53.293863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 388/768] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:53.295122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:53.449288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff13a-347a-458e-9157-69b3fa6609d9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.466779 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608d55-fa34-40d3-b72e-c2a13fa49015 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.514641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.515310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.515591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.515866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.516650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:53.516952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.520783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:53.521670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.522325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.522602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.522981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.523683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] RBAC: Adding query filter params (type=network) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:53.523985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.525319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:53.535921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 381/769] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:53:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:53.546727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 389/770] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:53.548869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:53.556382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:53.674661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc75fd-e2e7-4a77-b338-4b4304648560 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.675847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091d9c-8406-43ef-a189-58424e589ec4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.728478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.729144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.729426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.729699 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.730494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] RBAC: Adding query filter params (interface=public, service_id=8baf08ec6c6545e587110269898348a9, region_id=RegionOne) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:53.730824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.732194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:53.742585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab49e2b-5a60-4a00-9538-ba04593c0d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.743524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49e2b-5a60-4a00-9538-ba04593c0d62 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.743804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49e2b-5a60-4a00-9538-ba04593c0d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.744075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49e2b-5a60-4a00-9538-ba04593c0d62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.744917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab49e2b-5a60-4a00-9538-ba04593c0d62 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=e485723f69be454a99c9a41adf4b5dbb) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:53.745226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab49e2b-5a60-4a00-9538-ba04593c0d62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.746684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab49e2b-5a60-4a00-9538-ba04593c0d62 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:53.751437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 390/771] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:53:53 2022] GET /identity/v3/endpoints?service_id=8baf08ec6c6545e587110269898348a9&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:53.756305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 382/772] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:53 2022] GET /identity/v3/role_assignments?user.id=e485723f69be454a99c9a41adf4b5dbb&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:53.757444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:53.824297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d4fb-dcc5-42d9-ad7b-3ef18ca96fbf None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.824614 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d4fb-dcc5-42d9-ad7b-3ef18ca96fbf None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.824848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d4fb-dcc5-42d9-ad7b-3ef18ca96fbf None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.826720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 383/773] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:53.842804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3665d8-b023-404b-b648-6d330967165f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.843123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3665d8-b023-404b-b648-6d330967165f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.843352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3665d8-b023-404b-b648-6d330967165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.868278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ff3665d8-b023-404b-b648-6d330967165f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:53.869502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ff3665d8-b023-404b-b648-6d330967165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:53.927121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280ac4-6297-460d-ba6d-ccac41feb064 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:53.991991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:53.992592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:53.993162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:53.993442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:53.994130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:53.996784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 384/774] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:53:54.001778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:54.008565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 391/775] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:53:53 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:54.028634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3665d8-b023-404b-b648-6d330967165f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:54.140883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3665d8-b023-404b-b648-6d330967165f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:54.179689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:54.180570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:54.180859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:54.181136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:54.181804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:54.183246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:54.196135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 31 17:53:54.197679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 385/776] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Mar 31 17:53:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:54.203700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:54.319780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5c5e3-1e8c-4fad-a842-8aa6bbf37248 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:54.359631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:54.360298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:54.360576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:54.360848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:54.362200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:54.362506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:54.363907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:54.369198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 392/777] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Mar 31 17:53:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:54.374378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:54.490775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a0f80-64f7-4a64-a56d-f3b505cc3719 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:54.530191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:54.530893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:54.531179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:54.531454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:54.532175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:54.532482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:54.534945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:54.540562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 386/778] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Mar 31 17:53:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:54.546234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:54.706758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e246f-acd9-42b1-8085-48688aa65f35 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:54.754282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e40a3-8705-43eb-aabe-6b14bd2db307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:54.755209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e40a3-8705-43eb-aabe-6b14bd2db307 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:54.755632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e40a3-8705-43eb-aabe-6b14bd2db307 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:54.756042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e40a3-8705-43eb-aabe-6b14bd2db307 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:54.756987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e40a3-8705-43eb-aabe-6b14bd2db307 None admin] RBAC: Adding query filter params (interface=public, service_id=daf76ece46e04248afbaba08e86bbf5c, region_id=RegionOne) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:54.757435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e40a3-8705-43eb-aabe-6b14bd2db307 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:54.758955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e40a3-8705-43eb-aabe-6b14bd2db307 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:54.771709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 393/779] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:53:54 2022] GET /identity/v3/endpoints?service_id=daf76ece46e04248afbaba08e86bbf5c&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:54.776734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:54.994674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98818d8-9cf2-4048-b678-1d00b497ebcc None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:55.039429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467031a-d0aa-4e8c-9003-a29c0b37f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:55.040142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467031a-d0aa-4e8c-9003-a29c0b37f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:55.040431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467031a-d0aa-4e8c-9003-a29c0b37f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:55.040712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467031a-d0aa-4e8c-9003-a29c0b37f4e1 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:55.041431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467031a-d0aa-4e8c-9003-a29c0b37f4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:55.042867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467031a-d0aa-4e8c-9003-a29c0b37f4e1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:55.048851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 387/780] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:53:54 2022] GET /identity/v3/services => generated 772 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:55.371991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce63b6-c6e6-41a4-b76d-253d680ebf42 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:55.372842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce63b6-c6e6-41a4-b76d-253d680ebf42 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:55.373269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce63b6-c6e6-41a4-b76d-253d680ebf42 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:55.375457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 394/781] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:55.381811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63dd9-783d-4f2b-9fbf-879f5f98c832 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:55.382633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63dd9-783d-4f2b-9fbf-879f5f98c832 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:55.383064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63dd9-783d-4f2b-9fbf-879f5f98c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:55.402724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6dc63dd9-783d-4f2b-9fbf-879f5f98c832 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:55.404168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6dc63dd9-783d-4f2b-9fbf-879f5f98c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:55.480899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 388/782] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:53:55.504601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce63b6-c6e6-41a4-b76d-253d680ebf42 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:55.616095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce63b6-c6e6-41a4-b76d-253d680ebf42 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:55.652632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:55.653659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:55.654107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:55.654526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:55.666280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:55.669994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e0cf-daff-454d-9838-ee39b6de0cf7 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:55.670466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e0cf-daff-454d-9838-ee39b6de0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:55.670993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e0cf-daff-454d-9838-ee39b6de0cf7 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:55.672907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 389/783] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:53:55.678597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df7326-1113-4daf-ab2f-202813fb5776 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:55.679099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df7326-1113-4daf-ab2f-202813fb5776 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:55.679523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df7326-1113-4daf-ab2f-202813fb5776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:55.679686 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:55.683811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 395/784] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:55.686822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:55.710761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d1df7326-1113-4daf-ab2f-202813fb5776 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:55.712184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d1df7326-1113-4daf-ab2f-202813fb5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:55.802429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11046719-7a4b-4e7d-9d17-0ff3b89dbfc7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:55.842867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:55.843545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:55.843829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:55.844102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:55.844856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:55.845164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:55.847923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:55.857620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 396/785] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:53:55.863786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:55.900296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 390/786] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:53:55.937213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df7326-1113-4daf-ab2f-202813fb5776 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:55.977791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a8cc-9d7b-428c-8e86-d5183abbcca5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.020386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.021185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.021467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.021743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.034640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:56.036238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:56.054552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:56.056080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 397/787] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:56.066364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.183768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df7326-1113-4daf-ab2f-202813fb5776 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.222637 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.223439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.223720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.223993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.242653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2b9b-e7dc-4ef9-a4a4-d6aa5e0c5cad None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.244055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:56.252807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:53:56.254008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 391/788] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:56.262632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.311685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.312358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.312640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.312918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.313648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:56.313953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:56.316106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:56.347662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 398/789] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:56.353855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.419320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d642ed-8d2c-47d1-9622-be1698b0a8c2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.456676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a1c3-8211-4878-9130-72d18d7d263e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.457358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a1c3-8211-4878-9130-72d18d7d263e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.457645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a1c3-8211-4878-9130-72d18d7d263e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.457919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a1c3-8211-4878-9130-72d18d7d263e None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.458710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a1c3-8211-4878-9130-72d18d7d263e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:56.459022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a1c3-8211-4878-9130-72d18d7d263e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:56.460400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a1c3-8211-4878-9130-72d18d7d263e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:56.469299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 392/790] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:56.470484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382720f5-70a6-457a-ba2f-7a3dfcdd26c5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.471088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acc50-7d01-49d4-ab0e-e3517cfecd0b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.471595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acc50-7d01-49d4-ab0e-e3517cfecd0b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.471884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acc50-7d01-49d4-ab0e-e3517cfecd0b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.473953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 393/791] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:56.479999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3e72-1069-4328-ba41-3b8ae03ac465 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.480389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3e72-1069-4328-ba41-3b8ae03ac465 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.480889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3e72-1069-4328-ba41-3b8ae03ac465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.499895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f27a3e72-1069-4328-ba41-3b8ae03ac465 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:56.501444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f27a3e72-1069-4328-ba41-3b8ae03ac465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:56.513987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.514808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.515090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.515397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.522747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:56.524193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:56.538467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 31 17:53:56.544326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 399/792] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:53:56.544326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.582720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 394/793] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:53:56.583915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3e72-1069-4328-ba41-3b8ae03ac465 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.665875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f82f-025c-4b73-b8cd-e225755a028c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.692852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3e72-1069-4328-ba41-3b8ae03ac465 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.701756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.702078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.702358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.702641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.714102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:56.715612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:56.733864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:56.734330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.735268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.735754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.736386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.737720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:56.738267 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:56.739650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 400/794] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:56.740261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:56.740484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.765066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 395/795] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:56.766389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.838804 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865090a-8de1-44df-8ce9-2359bb4414cf None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.870766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e590c-93f4-4c78-9587-6f629cee841e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:56.872608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.874050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.874050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.874050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.884381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:53:56.891427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:53:56.898021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 401/796] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:56.899005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:56.909976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:56.911075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:56.911541 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:56.911996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:56.912968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:56.913477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:56.915163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:56.928270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 396/797] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:56.929455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.002978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ef6ba-feda-436b-8b36-8521a0ad4f4e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.036505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854d4dc-c1d5-4782-8f63-89a6414dcefd None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.037408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.038207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.038533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.038839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.063274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.066800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.085699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453cfca-5523-429e-8cec-5a98e7439312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.086432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453cfca-5523-429e-8cec-5a98e7439312 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.086764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453cfca-5523-429e-8cec-5a98e7439312 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.087024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453cfca-5523-429e-8cec-5a98e7439312 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.087144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:57.087767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453cfca-5523-429e-8cec-5a98e7439312 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:57.088091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453cfca-5523-429e-8cec-5a98e7439312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.088522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 402/798] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:57.093519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.093661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453cfca-5523-429e-8cec-5a98e7439312 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.100240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 397/799] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:53:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:57.101968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d27c5-e9bd-4502-8636-938123acda6b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.102472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d27c5-e9bd-4502-8636-938123acda6b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.103012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d27c5-e9bd-4502-8636-938123acda6b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.104966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 398/800] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:57.105908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d27c5-e9bd-4502-8636-938123acda6b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.207432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef885ba-b6a1-4d11-a7a8-a81f80f5d0c7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.208241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d27c5-e9bd-4502-8636-938123acda6b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.240382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e81be-645e-4668-9b6d-1663d920029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.241191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e81be-645e-4668-9b6d-1663d920029e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.241474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e81be-645e-4668-9b6d-1663d920029e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.241748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e81be-645e-4668-9b6d-1663d920029e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.243747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.244415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.244700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.244981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.245705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:57.246015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.247409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.250133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e81be-645e-4668-9b6d-1663d920029e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.251596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e81be-645e-4668-9b6d-1663d920029e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.264494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 399/801] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:57.264494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.265317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-589e81be-645e-4668-9b6d-1663d920029e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:53:57.271149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 403/802] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:57.271149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec304a-802d-4628-8fd9-17cee3999191 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.271149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec304a-802d-4628-8fd9-17cee3999191 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.271149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec304a-802d-4628-8fd9-17cee3999191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.285064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-afec304a-802d-4628-8fd9-17cee3999191 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:57.286236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-afec304a-802d-4628-8fd9-17cee3999191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:57.362639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 404/803] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:53:57.362639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec304a-802d-4628-8fd9-17cee3999191 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.383028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c63f24-9ac6-4411-a813-920730fb1eca None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.416749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.417562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.417840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.418113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.429304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.430854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.450328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:57.456563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 400/804] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:57.456563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.463696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec304a-802d-4628-8fd9-17cee3999191 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.499980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.501517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.502066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.502587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.509433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.510913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.524007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:57.529976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 405/805] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:57.530521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.552703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885067b6-a0a0-42ab-89c4-5ec86029bc24 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.585978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.586832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.587251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.587659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.588618 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:57.589037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.590464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.613039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 401/806] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:57.613039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.637009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9e329-d32f-440f-b269-d11044564417 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.670233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.671057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.671336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.671613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] PATH_INFO: `/v3/services/network` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.672261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.673610 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.684795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 31 17:53:57.690930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 406/807] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:57.690930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.710320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704a39-7c62-4852-a37f-bbdaf1411bb7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.743985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.744645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.744925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.745200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.745915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:57.746218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.747602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.758600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 402/808] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:57.759437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.797485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5a91-37e4-4e96-af80-bd86ade7f863 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.830511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.831197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.831477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.831752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.832529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:57.832842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.834250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.846316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 407/809] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:57.847137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:57.858907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ec2f4-e77e-44ca-8986-ef5635ebbd80 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.890293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff130d-70bb-43f3-964e-cf2d53041862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.890958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff130d-70bb-43f3-964e-cf2d53041862 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.891241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff130d-70bb-43f3-964e-cf2d53041862 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.891515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff130d-70bb-43f3-964e-cf2d53041862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.939951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919ce3e-aa12-4f40-83ed-be7ab88dc345 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:57.954483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff130d-70bb-43f3-964e-cf2d53041862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.956598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff130d-70bb-43f3-964e-cf2d53041862 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.972545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:57.973207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:57.973484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:57.973756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:57.974458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] RBAC: Adding query filter params (name=network) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:57.974791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:57.976131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:57.980392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 408/810] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:57.981154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.050340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 403/811] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:53:58.052066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538fbc-1c4d-417e-aca5-4c8d90cf106f None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.052066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538fbc-1c4d-417e-aca5-4c8d90cf106f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.054466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538fbc-1c4d-417e-aca5-4c8d90cf106f None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.054466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 404/812] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:53:58.055575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538fbc-1c4d-417e-aca5-4c8d90cf106f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.081403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38088-c0d7-4868-90a5-3e6f6da8133c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.112941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.113739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.114013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.114280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.121339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.122793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.137822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 31 17:53:58.138984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 409/813] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:53:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:58.139729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.155134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538fbc-1c4d-417e-aca5-4c8d90cf106f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.188852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d115b-94b5-4c18-8f05-a6fee8aea04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.189860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d115b-94b5-4c18-8f05-a6fee8aea04f None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.190155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d115b-94b5-4c18-8f05-a6fee8aea04f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.190417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d115b-94b5-4c18-8f05-a6fee8aea04f None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/f3b2e34e638041f7a5338c0d8ae1fa25/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.192427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d115b-94b5-4c18-8f05-a6fee8aea04f None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=f3b2e34e638041f7a5338c0d8ae1fa25, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.193846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d115b-94b5-4c18-8f05-a6fee8aea04f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.233240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f29953-4fc5-4fb6-adf5-4ef6f2e7257c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.265614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.268017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.268017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.268017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.268017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] RBAC: Adding query filter params (type=network) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:58.268017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.269216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.273820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 410/814] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:58.274577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.291867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 405/815] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:58 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/f3b2e34e638041f7a5338c0d8ae1fa25/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:53:58.293109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1cbd-92e1-4119-809a-35f33ce3310a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.293486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1cbd-92e1-4119-809a-35f33ce3310a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.293695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1cbd-92e1-4119-809a-35f33ce3310a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.318814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-592c1cbd-92e1-4119-809a-35f33ce3310a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:53:58.320013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-592c1cbd-92e1-4119-809a-35f33ce3310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:53:58.380256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0dcbd-4c17-42eb-a994-0b7e61a44708 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.391258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 406/816] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:53:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:53:58.393009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c1cbd-92e1-4119-809a-35f33ce3310a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.416566 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.417649 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.417935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.418204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.429854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.431381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.450685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:58.457173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 411/817] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:58.457173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.507117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c1cbd-92e1-4119-809a-35f33ce3310a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.540345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.541014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.541295 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.541572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.542401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:58.542738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.544153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.558523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600cdb6-3fb4-42d5-ac95-209fdc228832 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.566837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 407/818] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:58.566837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.592848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.593424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.593703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.593972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.594773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.596179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.664523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305e1e1-c3f0-49b9-9a90-07a04e8f98e9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.682274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 412/819] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:53:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:58.685587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.707112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.708736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.709446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.709868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.710725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.712872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.728616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 31 17:53:58.732828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 408/820] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:58.732828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.811596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9e7b7-7d76-43c5-9cee-a151435a129d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.852678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.853372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.853791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.854053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.854911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:58.855285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.857032 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.868792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a665a8-d90e-4967-8db1-cda2eb24da1e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:58.871150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 413/821] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:58.872178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.904341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:58.905679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:58.905679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:58.905679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:58.919461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:58.920932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:58.938305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:53:58.939877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 409/822] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:58.940489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:58.986216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3780a-4c5d-47ff-b618-928c75f3eb1d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.022096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.022797 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.023081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.023354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.024052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:59.024352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.025719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.030147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 414/823] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:59.031428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.047122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c647ea-3f5b-4fa0-8fa9-469b11ab2617 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.080520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.081317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.081601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.081895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.088695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.090169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.104074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:59.107176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 410/824] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:59.107176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.143264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572495b5-370c-4177-a85c-f289a4034eb6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.178725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.179893 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.180507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.180886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.181712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:59.182122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.183618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.199997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 415/825] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:59.199997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.204381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ea65-9157-4ede-92e7-07d7b51af54e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.239503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.240277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.240625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.240967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.241871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:59.242248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.243952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.249174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 411/826] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Mar 31 17:53:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:59.250053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.303046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c5fa-d5dc-4720-8fef-d7c49c54b0ee None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.335697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.336369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.336640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.336914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.337688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:59.338296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.339522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.347026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4cb3e-b5c7-4fa5-a189-6cbf5332c677 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.357002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 416/827] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:59.357002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.385162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.386180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.386666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.386939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.393713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.400538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.407949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:53:59.413834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 412/828] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:53:59.413834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.457299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff85ecc-a61f-4ce4-88c5-a0421c0db6f9 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.491784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.492440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.492714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.492995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.494044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.495430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.512449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeaf0b-a343-460d-8c52-d7361f620462 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.545271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.545919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.546245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.546572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.547420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7e46af6e41bb45c08e5a6b9fd596e4f1) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:59.547730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.549749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.555296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 413/829] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:53:59 2022] GET /identity/v3/role_assignments?user.id=7e46af6e41bb45c08e5a6b9fd596e4f1&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:59.556123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.573139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 417/830] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:53:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:53:59.669420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b258bde-ddca-4160-b9ea-007205fa5467 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.717080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b056-323f-4758-8d7d-41ec636591ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.718032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b056-323f-4758-8d7d-41ec636591ca None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.718582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b056-323f-4758-8d7d-41ec636591ca None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.719052 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b056-323f-4758-8d7d-41ec636591ca None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.720021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b056-323f-4758-8d7d-41ec636591ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:53:59.720498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b056-323f-4758-8d7d-41ec636591ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.723095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b056-323f-4758-8d7d-41ec636591ca None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.738314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 414/831] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:53:59.745032 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:53:59.857177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91f42-5f70-4825-931c-4ea90e6f16bc None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:53:59.891737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0285-6c39-4ccd-8b16-1e2ec8d1015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:53:59.893176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0285-6c39-4ccd-8b16-1e2ec8d1015d None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:53:59.893535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0285-6c39-4ccd-8b16-1e2ec8d1015d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:53:59.893980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0285-6c39-4ccd-8b16-1e2ec8d1015d None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/e485723f69be454a99c9a41adf4b5dbb/roles/4428e6eb6e55408d98a28a91a43b4935` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:53:59.908735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0285-6c39-4ccd-8b16-1e2ec8d1015d None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=e485723f69be454a99c9a41adf4b5dbb, role_id=4428e6eb6e55408d98a28a91a43b4935)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:53:59.910269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0285-6c39-4ccd-8b16-1e2ec8d1015d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:53:59.996363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 418/832] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:53:59 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/e485723f69be454a99c9a41adf4b5dbb/roles/4428e6eb6e55408d98a28a91a43b4935 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:54:00.646559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200fcb-e9fb-4dd2-9f8c-8426ba16b812 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:00.647102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200fcb-e9fb-4dd2-9f8c-8426ba16b812 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:00.647203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200fcb-e9fb-4dd2-9f8c-8426ba16b812 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:00.649287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 415/833] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:00.654692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597da433-9c7b-444a-8151-7c3481e05440 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:00.655107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597da433-9c7b-444a-8151-7c3481e05440 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:00.655309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597da433-9c7b-444a-8151-7c3481e05440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:00.672381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-597da433-9c7b-444a-8151-7c3481e05440 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:00.673558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-597da433-9c7b-444a-8151-7c3481e05440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:00.747777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 419/834] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:00.768852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200fcb-e9fb-4dd2-9f8c-8426ba16b812 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:00.878437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200fcb-e9fb-4dd2-9f8c-8426ba16b812 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:00.914290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:00.915033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:00.915311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:00.915586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:00.926082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:00.932921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:54:00.938963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 416/835] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:54:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:00.940604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597da433-9c7b-444a-8151-7c3481e05440 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:01.039151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597da433-9c7b-444a-8151-7c3481e05440 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:01.075442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:01.076111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:01.076387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:01.076658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:01.077395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:01.077697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:01.079095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:01.092667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 420/836] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:54:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:01.094014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:01.198868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823949a8-a8a5-444c-85e6-3da484686a1e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:01.232378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:01.233183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:01.233464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:01.233742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:01.244909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:01.246361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:01.263252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:01.264775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 417/837] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:01.270762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:01.372823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82a4a8-9722-40a9-bd5c-e1945293f0ec None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:01.408470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:01.409132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:01.409412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:01.409729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:01.410455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:01.411104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:01.412520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:01.430692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 421/838] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:01.432000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:01.539672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7758-06bf-4fe6-9df8-1545b671676f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:01.573964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:01.574793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:01.575080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:01.575356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:01.583227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:01.584673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:01.598303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 31 17:54:01.599869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 418/839] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:54:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:01.607991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:01.722342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47714f51-16f1-457d-a3c0-39567bce20e8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:01.757993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83208917-9cbe-4e4d-ad38-5f914c0fe597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:01.758675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208917-9cbe-4e4d-ad38-5f914c0fe597 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:01.758955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208917-9cbe-4e4d-ad38-5f914c0fe597 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:01.759229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208917-9cbe-4e4d-ad38-5f914c0fe597 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:01.760060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83208917-9cbe-4e4d-ad38-5f914c0fe597 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:01.760365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83208917-9cbe-4e4d-ad38-5f914c0fe597 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:01.762101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83208917-9cbe-4e4d-ad38-5f914c0fe597 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:01.784038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 422/840] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Mar 31 17:54:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:01.786514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:01.896388 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694a75-9537-4be6-a636-fd2c41d0bb94 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:01.930696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:01.931347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:01.931627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:01.931898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:01.992545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d68acb-8f63-4b6d-bb18-6df85e5d7fca None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:01.992872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d68acb-8f63-4b6d-bb18-6df85e5d7fca None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:01.993081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d68acb-8f63-4b6d-bb18-6df85e5d7fca None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:01.996459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 423/841] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:54:02.002921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfd89-c94a-42c3-9450-320bdf84b5bf None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.003383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfd89-c94a-42c3-9450-320bdf84b5bf None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.003681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfd89-c94a-42c3-9450-320bdf84b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.011983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.013440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.020923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7e2cfd89-c94a-42c3-9450-320bdf84b5bf None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:02.022086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7e2cfd89-c94a-42c3-9450-320bdf84b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:02.088099 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 424/842] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:02.089487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e7a4a-fb70-42b3-8b28-c1c520dac9a9 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.089773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e7a4a-fb70-42b3-8b28-c1c520dac9a9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.090049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e7a4a-fb70-42b3-8b28-c1c520dac9a9 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.094638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 425/843] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:02.100090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d33c-f72c-44e9-b4b1-b191deaddf3d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.100564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d33c-f72c-44e9-b4b1-b191deaddf3d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.100985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d33c-f72c-44e9-b4b1-b191deaddf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.119181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a6e6d33c-f72c-44e9-b4b1-b191deaddf3d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:02.120348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a6e6d33c-f72c-44e9-b4b1-b191deaddf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:02.136301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 419/844] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:54:02.137316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.191821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 426/845] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:02.192907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d33c-f72c-44e9-b4b1-b191deaddf3d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.255338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92615-25bd-456e-bccf-70365d87d968 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.293852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d33c-f72c-44e9-b4b1-b191deaddf3d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.297020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.297821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.298100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.298372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.299194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.300582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.314922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 31 17:54:02.321420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 420/846] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:02.321420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.326903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.327690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.327964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.328225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.338750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.340182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.357472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:02.358668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 427/847] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:02.359488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.417222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89fefe-7658-4155-aa3f-3496ce4afbac None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.448807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c02e9-3d3c-4450-861e-20eb63155072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.449568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c02e9-3d3c-4450-861e-20eb63155072 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.449850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c02e9-3d3c-4450-861e-20eb63155072 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.450120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c02e9-3d3c-4450-861e-20eb63155072 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.450795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c02e9-3d3c-4450-861e-20eb63155072 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.452094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44398e59-f8c2-4087-a89e-562e05d34291 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.452201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c02e9-3d3c-4450-861e-20eb63155072 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.464163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-100c02e9-3d3c-4450-861e-20eb63155072 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 31 17:54:02.465336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 421/848] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:02.466490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e600e-9395-4b37-81aa-5ddfbb1ea023 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.466800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e600e-9395-4b37-81aa-5ddfbb1ea023 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.467079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e600e-9395-4b37-81aa-5ddfbb1ea023 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.470536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 422/849] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:02.470536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e600e-9395-4b37-81aa-5ddfbb1ea023 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.487360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.488019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.488351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.488605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.489305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:02.489608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.490979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.499994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 428/850] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:02.499994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.566055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e600e-9395-4b37-81aa-5ddfbb1ea023 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.589417 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920438fa-f7e0-4ca4-acce-8962ad4645d8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.598080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785100b-7b6e-42d0-a336-88ffa5c9d378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.598784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785100b-7b6e-42d0-a336-88ffa5c9d378 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.599063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785100b-7b6e-42d0-a336-88ffa5c9d378 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.599332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785100b-7b6e-42d0-a336-88ffa5c9d378 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.600052 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785100b-7b6e-42d0-a336-88ffa5c9d378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:02.600355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785100b-7b6e-42d0-a336-88ffa5c9d378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.601700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785100b-7b6e-42d0-a336-88ffa5c9d378 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.613017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 423/851] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:02.614235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909c9e-35cc-4e71-8825-9b2fb63db1b0 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.614523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909c9e-35cc-4e71-8825-9b2fb63db1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.614843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909c9e-35cc-4e71-8825-9b2fb63db1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.622236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.622928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.623210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.623484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.624185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:02.624490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.625835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.631476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 429/852] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:02.631705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-df909c9e-35cc-4e71-8825-9b2fb63db1b0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:02.632247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.632883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-df909c9e-35cc-4e71-8825-9b2fb63db1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:02.698677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 424/853] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:02.699557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909c9e-35cc-4e71-8825-9b2fb63db1b0 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.726789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a012-5e29-4045-b413-2021587df615 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.759888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.760549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.760827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.761100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.761801 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:02.762107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.763484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.767805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 430/854] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:02.768781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.798277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909c9e-35cc-4e71-8825-9b2fb63db1b0 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.836413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.837229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.837506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.837779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.845018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.846878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.860755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:02.863004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 425/855] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:02.864044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.875352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f74316-ef57-471c-86cb-b3f31a887245 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:02.911915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:02.912739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:02.913018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:02.913293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:02.914014 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:02.914325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:02.915789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:02.930650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 431/856] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:02.930650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:02.995635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6640-a826-4473-b69e-865eea52c1aa None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.033962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e1537-184e-41ce-a77b-ae6e1cce3b43 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.037547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.038655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.039127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.039600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.064276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:03.075168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:54:03.077195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 426/857] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:03.082966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.083408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:03.084195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.084638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.085105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.086109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:03.086629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:03.088308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:03.101835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 432/858] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:03.111363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:03.214979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8dd68-bc25-4bf7-8fc9-ca2840996941 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.223726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3dba2-f528-4c50-9208-54bb91668c59 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.251708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.253789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.254552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.255077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.256036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:03.256557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:03.258083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.258240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:03.259064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.259501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.259930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.260891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=f3b2e34e638041f7a5338c0d8ae1fa25) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:03.261387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:03.263276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:03.269183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 427/859] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:03.270401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 433/860] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:03 2022] GET /identity/v3/role_assignments?user.id=f3b2e34e638041f7a5338c0d8ae1fa25&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:03.275746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:03.381276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f86e8-85b5-470d-b93b-6190d15763b7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.417230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.418390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.418923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.419494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.432422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:03.434403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:03.452787 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:03.454804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 428/861] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:03.460916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:03.564499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1191a-7b45-40ca-88dc-8b3dfde2f279 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.599608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.600724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.601253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.601722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.602688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:03.603229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:03.604792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:03.618011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 434/862] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:03.624063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:03.728125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d298a-352d-4d98-b5ab-3673cbb148bc None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.762058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.762900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.763184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.763462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.771974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:03.773463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:03.788717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 31 17:54:03.790250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 429/863] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:54:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:03.795761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:03.899128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d01d-67c9-4caf-9f57-c46bad9f09ef None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:03.933457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:03.934485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:03.935029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:03.935512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:03.936547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:03.937052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:03.938690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:03.960074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 435/864] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Mar 31 17:54:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:03.965928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:04.071606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab361-064a-4eda-aa8c-a872692aad48 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:04.106253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:04.106971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:04.107256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:04.107539 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:04.176737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:04.178523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:04.277545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 430/865] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:54:04.282792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:04.382580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd183fb-d5cc-4a46-a3d6-0c4c7d19e899 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:04.418174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:04.419389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:04.419894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:04.420376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:04.431196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:04.432919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:04.450852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:04.452668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 436/866] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:04.459089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:04.564013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9673d04-b395-4c7f-896d-33386c012f6d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:04.599466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:04.600594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:04.601091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:04.601583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:04.602704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:04.603214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:04.604790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:04.616952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 431/867] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:04.623083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:04.723118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3bdb-4f87-4edb-9377-e3990df7e0fc None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:04.757604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c376b3-619a-4725-8613-658057220b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:04.758399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c376b3-619a-4725-8613-658057220b8b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:04.758698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c376b3-619a-4725-8613-658057220b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:04.758971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c376b3-619a-4725-8613-658057220b8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:04.766267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c376b3-619a-4725-8613-658057220b8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:04.767827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c376b3-619a-4725-8613-658057220b8b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:04.782895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-44c376b3-619a-4725-8613-658057220b8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:04.785109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 437/868] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:04.791096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:04.891451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e3a5-db86-4954-89be-a7397215643c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:04.927307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2b44b-8647-4771-9ff0-c534c945f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:04.928386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2b44b-8647-4771-9ff0-c534c945f25d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:04.928885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2b44b-8647-4771-9ff0-c534c945f25d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:04.929368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2b44b-8647-4771-9ff0-c534c945f25d None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:04.930402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2b44b-8647-4771-9ff0-c534c945f25d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:04.931015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2b44b-8647-4771-9ff0-c534c945f25d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:04.932820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2b44b-8647-4771-9ff0-c534c945f25d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:04.947845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 432/869] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:04.954204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c376b3-619a-4725-8613-658057220b8b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:05.061799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c376b3-619a-4725-8613-658057220b8b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:05.095842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb7f0-fc32-4891-93cc-0a3ecbe22f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:05.097025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb7f0-fc32-4891-93cc-0a3ecbe22f37 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.097308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb7f0-fc32-4891-93cc-0a3ecbe22f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.097581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb7f0-fc32-4891-93cc-0a3ecbe22f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.098411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb7f0-fc32-4891-93cc-0a3ecbe22f37 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=e485723f69be454a99c9a41adf4b5dbb) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:05.098744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb7f0-fc32-4891-93cc-0a3ecbe22f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:05.100157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb7f0-fc32-4891-93cc-0a3ecbe22f37 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:05.106463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 438/870] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:04 2022] GET /identity/v3/role_assignments?user.id=e485723f69be454a99c9a41adf4b5dbb&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:05.141305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867176a-9b5e-454a-9bb2-d8a43d58e83e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.141846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867176a-9b5e-454a-9bb2-d8a43d58e83e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.141846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867176a-9b5e-454a-9bb2-d8a43d58e83e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.144754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 433/871] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:05.150508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb2bd-b511-4b8c-a7c0-99a24ceb5fa1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.150849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb2bd-b511-4b8c-a7c0-99a24ceb5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.151126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb2bd-b511-4b8c-a7c0-99a24ceb5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.174659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-83cdb2bd-b511-4b8c-a7c0-99a24ceb5fa1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:05.174934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-83cdb2bd-b511-4b8c-a7c0-99a24ceb5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:05.249203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 439/872] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:05.272542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867176a-9b5e-454a-9bb2-d8a43d58e83e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:05.318070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11e8c9-36fb-45c8-89a8-7fb3b7f90c59 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.318251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11e8c9-36fb-45c8-89a8-7fb3b7f90c59 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.318530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11e8c9-36fb-45c8-89a8-7fb3b7f90c59 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.320981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 440/873] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:54:05.326535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733b5d-f84e-44b4-a15f-853785280b59 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.327508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733b5d-f84e-44b4-a15f-853785280b59 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.327508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733b5d-f84e-44b4-a15f-853785280b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.347289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f6733b5d-f84e-44b4-a15f-853785280b59 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:05.348621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f6733b5d-f84e-44b4-a15f-853785280b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:05.391686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867176a-9b5e-454a-9bb2-d8a43d58e83e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:05.435302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc56e9-6088-4ecd-bf61-21b109884190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:05.436368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc56e9-6088-4ecd-bf61-21b109884190 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.436890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc56e9-6088-4ecd-bf61-21b109884190 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.437391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc56e9-6088-4ecd-bf61-21b109884190 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.438317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc56e9-6088-4ecd-bf61-21b109884190 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:05.440020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc56e9-6088-4ecd-bf61-21b109884190 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:05.442752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 441/874] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:05.460980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6733b5d-f84e-44b4-a15f-853785280b59 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:05.546431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 434/875] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:54:05 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:05.579467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6733b5d-f84e-44b4-a15f-853785280b59 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:05.625993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7955e8-def9-4cea-b3ad-2935e40e7b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:05.627126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7955e8-def9-4cea-b3ad-2935e40e7b34 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.628286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7955e8-def9-4cea-b3ad-2935e40e7b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.628774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7955e8-def9-4cea-b3ad-2935e40e7b34 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.629882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7955e8-def9-4cea-b3ad-2935e40e7b34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:05.631527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7955e8-def9-4cea-b3ad-2935e40e7b34 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:05.722930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 442/876] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:54:05 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:05.834178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454cea1-6dd2-4a29-a33d-fbc9216e0959 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.834367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454cea1-6dd2-4a29-a33d-fbc9216e0959 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.834667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454cea1-6dd2-4a29-a33d-fbc9216e0959 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.836743 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 435/877] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:05.842351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796380-5aef-413e-8446-3b16feea9d1c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:05.842677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796380-5aef-413e-8446-3b16feea9d1c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:05.842963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796380-5aef-413e-8446-3b16feea9d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:05.861277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-63796380-5aef-413e-8446-3b16feea9d1c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:05.863112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-63796380-5aef-413e-8446-3b16feea9d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:05.945696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 443/878] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:05.968578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454cea1-6dd2-4a29-a33d-fbc9216e0959 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:06.073305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454cea1-6dd2-4a29-a33d-fbc9216e0959 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:06.107885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:06.108613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:06.108889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:06.109163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:06.109818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:06.111200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:06.122804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 31 17:54:06.124306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 436/879] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:06.130006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63796380-5aef-413e-8446-3b16feea9d1c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:06.232097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63796380-5aef-413e-8446-3b16feea9d1c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:06.267603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804d05b-ec8e-4118-85d7-b9e207d1f392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:06.268847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804d05b-ec8e-4118-85d7-b9e207d1f392 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:06.269128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804d05b-ec8e-4118-85d7-b9e207d1f392 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:06.269404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804d05b-ec8e-4118-85d7-b9e207d1f392 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:06.270105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804d05b-ec8e-4118-85d7-b9e207d1f392 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:06.270406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804d05b-ec8e-4118-85d7-b9e207d1f392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:06.271798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804d05b-ec8e-4118-85d7-b9e207d1f392 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:06.276811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 444/880] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:06.282402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:06.383268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594ae47-3a93-4052-8270-ac84b16e1d76 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:06.419309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b8299-5128-4564-b868-babf6a2075d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:06.419974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b8299-5128-4564-b868-babf6a2075d5 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:06.420255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b8299-5128-4564-b868-babf6a2075d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:06.420525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b8299-5128-4564-b868-babf6a2075d5 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:06.421229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b8299-5128-4564-b868-babf6a2075d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:06.421533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b8299-5128-4564-b868-babf6a2075d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:06.422926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b8299-5128-4564-b868-babf6a2075d5 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:06.427930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 437/881] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:07.626885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab88b-1a6b-4558-b080-1a7a98c7c310 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:07.628783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab88b-1a6b-4558-b080-1a7a98c7c310 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:07.629296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab88b-1a6b-4558-b080-1a7a98c7c310 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:07.631733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 445/882] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:07.637391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535d02-69ff-4588-a7e5-dd6b7adb1d92 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:07.638213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535d02-69ff-4588-a7e5-dd6b7adb1d92 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:07.638729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535d02-69ff-4588-a7e5-dd6b7adb1d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:07.656296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-98535d02-69ff-4588-a7e5-dd6b7adb1d92 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:07.657772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-98535d02-69ff-4588-a7e5-dd6b7adb1d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:07.730792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 438/883] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:07.750586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab88b-1a6b-4558-b080-1a7a98c7c310 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:07.857577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab88b-1a6b-4558-b080-1a7a98c7c310 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:07.891868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c1e1e-e7c4-4617-ac7a-2980adfc26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:07.893006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c1e1e-e7c4-4617-ac7a-2980adfc26a4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:07.893545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c1e1e-e7c4-4617-ac7a-2980adfc26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:07.894025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c1e1e-e7c4-4617-ac7a-2980adfc26a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:07.904453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c1e1e-e7c4-4617-ac7a-2980adfc26a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:07.913210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-020c1e1e-e7c4-4617-ac7a-2980adfc26a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 31 17:54:07.918732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 446/884] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Mar 31 17:54:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:07.921383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535d02-69ff-4588-a7e5-dd6b7adb1d92 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:07.924280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7c9d-e486-4d01-9860-1ec4c397eb69 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:07.924820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7c9d-e486-4d01-9860-1ec4c397eb69 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:07.925108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7c9d-e486-4d01-9860-1ec4c397eb69 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:07.926894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 447/885] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:07.932182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951610d-a9e0-4b5d-9c03-f81b0b1cd789 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:07.932470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951610d-a9e0-4b5d-9c03-f81b0b1cd789 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:07.932750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951610d-a9e0-4b5d-9c03-f81b0b1cd789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:07.949850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8951610d-a9e0-4b5d-9c03-f81b0b1cd789 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:07.952844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8951610d-a9e0-4b5d-9c03-f81b0b1cd789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:08.027419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 448/886] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:08.033034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535d02-69ff-4588-a7e5-dd6b7adb1d92 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.050792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951610d-a9e0-4b5d-9c03-f81b0b1cd789 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.069551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.070526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.071022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.071482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.072413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.072937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.074503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.083335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 439/887] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Mar 31 17:54:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:08.089035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.150775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951610d-a9e0-4b5d-9c03-f81b0b1cd789 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.185523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547715-6d0f-4027-a626-78fac6dd9b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.186694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547715-6d0f-4027-a626-78fac6dd9b98 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.186979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547715-6d0f-4027-a626-78fac6dd9b98 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.187251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547715-6d0f-4027-a626-78fac6dd9b98 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.187898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547715-6d0f-4027-a626-78fac6dd9b98 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.189256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547715-6d0f-4027-a626-78fac6dd9b98 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.193154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1a81-1576-409f-b3c2-7510e55c0c26 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.200240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-71547715-6d0f-4027-a626-78fac6dd9b98 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 31 17:54:08.201427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 449/888] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:08.204006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd471-43d4-4e10-9221-78f54f4ded24 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.204297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd471-43d4-4e10-9221-78f54f4ded24 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.204576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd471-43d4-4e10-9221-78f54f4ded24 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.210918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 450/889] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:08.211719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd471-43d4-4e10-9221-78f54f4ded24 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.229942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491069a-4f09-486d-952d-29fbee7cbfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.230823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491069a-4f09-486d-952d-29fbee7cbfed None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.231101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491069a-4f09-486d-952d-29fbee7cbfed None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.231369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491069a-4f09-486d-952d-29fbee7cbfed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.241690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491069a-4f09-486d-952d-29fbee7cbfed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.243185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491069a-4f09-486d-952d-29fbee7cbfed None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.259915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-3491069a-4f09-486d-952d-29fbee7cbfed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:08.265825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 440/890] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:08.265825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cdfd-940b-42f0-a615-97ceb0632c26 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.265825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cdfd-940b-42f0-a615-97ceb0632c26 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.265825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cdfd-940b-42f0-a615-97ceb0632c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.279582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-42a0cdfd-940b-42f0-a615-97ceb0632c26 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:08.280743 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-42a0cdfd-940b-42f0-a615-97ceb0632c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:08.321002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd471-43d4-4e10-9221-78f54f4ded24 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.353281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.353541 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 441/891] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:08.354180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.354466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.354766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.354887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cdfd-940b-42f0-a615-97ceb0632c26 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.355698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.356129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.357627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.362993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 451/892] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:08.368659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.465585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cdfd-940b-42f0-a615-97ceb0632c26 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.478113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0c16-2fbd-4801-bd2c-70a01f312262 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.499570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.500232 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.500514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.500787 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.501503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.502037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.503969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.512497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.513164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.513445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.513722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.514427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.514763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.520854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 442/893] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:08.521000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.521100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.521719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 452/894] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:08.522530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.620670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302b50-1119-4570-bc8c-260c1064a443 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.623188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919609f-4754-44b6-9a89-970987d4edb6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.652813 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.653622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.653898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.654167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.656512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.657324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.657604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.657874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.658524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.660612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.662516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.663955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.671915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 31 17:54:08.678786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 443/895] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:08.678786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.678996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 31 17:54:08.679597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 453/896] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:08.683949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.776904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e77d-d9c9-49e0-9cb6-8160385b6fad None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.779198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5d0c-727c-4448-ab81-215e2a6e9d0c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.810367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ed20b-5a11-4713-b7d6-036452d5ed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.811053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed20b-5a11-4713-b7d6-036452d5ed91 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.811333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed20b-5a11-4713-b7d6-036452d5ed91 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.811606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed20b-5a11-4713-b7d6-036452d5ed91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.812081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.812380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ed20b-5a11-4713-b7d6-036452d5ed91 None admin] RBAC: Adding query filter params (interface=public, service_id=e29affda89544c50aff2632385e42e81, region_id=RegionOne) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.812686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ed20b-5a11-4713-b7d6-036452d5ed91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.812774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.812996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.813267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.813956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.814044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ed20b-5a11-4713-b7d6-036452d5ed91 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.814256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.815778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.820225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 454/897] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:08.820991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.821593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 444/898] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/endpoints?service_id=e29affda89544c50aff2632385e42e81&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:08.822811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21344b8c-fc14-47dc-9eb8-48c6ace50075 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.823089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21344b8c-fc14-47dc-9eb8-48c6ace50075 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.823360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21344b8c-fc14-47dc-9eb8-48c6ace50075 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.825039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 445/899] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:08.825714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21344b8c-fc14-47dc-9eb8-48c6ace50075 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.921895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21344b8c-fc14-47dc-9eb8-48c6ace50075 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.924286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24a93-d243-4463-8eec-81cd77e30e9f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:08.953599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.954258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.954535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.954834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.955529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.956490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.957005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b91f34-bc25-438a-b810-d19fc1a8861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:08.957833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b91f34-bc25-438a-b810-d19fc1a8861a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.957920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.958118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b91f34-bc25-438a-b810-d19fc1a8861a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.958401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b91f34-bc25-438a-b810-d19fc1a8861a None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.959279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b91f34-bc25-438a-b810-d19fc1a8861a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:08.959613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b91f34-bc25-438a-b810-d19fc1a8861a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:08.961013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b91f34-bc25-438a-b810-d19fc1a8861a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:08.962533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 446/900] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:08.963319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:08.979201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 455/901] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:08.980528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796c53b-9fa5-4acc-8657-1a8f78d5b0e1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:08.980818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796c53b-9fa5-4acc-8657-1a8f78d5b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:08.981095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796c53b-9fa5-4acc-8657-1a8f78d5b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:08.997418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f796c53b-9fa5-4acc-8657-1a8f78d5b0e1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:08.998602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f796c53b-9fa5-4acc-8657-1a8f78d5b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:09.058849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a076-56b7-4bb4-a137-3eec0a31b39b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:09.062672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 456/902] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:09.063509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796c53b-9fa5-4acc-8657-1a8f78d5b0e1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:09.093161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:09.093831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:09.094115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:09.094392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:09.096039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:09.098162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:09.104064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 447/903] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:54:08 2022] GET /identity/v3/services => generated 1268 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 17:54:09.104898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:09.186198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796c53b-9fa5-4acc-8657-1a8f78d5b0e1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:09.244017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:09.245096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:09.245268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:09.245536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:09.246339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] RBAC: Adding query filter params (interface=public, service_id=f7a50692f6e34df19d9ab4b1ee4f3afb, region_id=RegionOne) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:09.246665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:09.248061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:09.248812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e5dbe-f9cd-414b-aed1-d2b2fc6badc9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:09.259096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 457/904] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:54:09 2022] GET /identity/v3/endpoints?service_id=f7a50692f6e34df19d9ab4b1ee4f3afb&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:09.259096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:09.291784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:09.292452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:09.292738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:09.293130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:09.379244 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f0c7d-01a8-4c8b-a7fa-d32bb8b6ee98 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:09.383636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:09.385357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:09.418642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:09.419964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:09.420755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:09.421332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:09.422393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:09.425001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:09.495882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 448/905] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:54:09.496816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:09.535378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 458/906] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:54:09 2022] POST /identity/v3/services => generated 241 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:09.535378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:09.631330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3445fa-36bd-413b-989d-da00e271b12d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:09.651370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a8033-940f-4c6f-b79b-d3141586abf7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:09.668113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:09.668795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:09.669063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:09.669335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:09.670030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:09.671457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:09.679012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 449/907] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:54:09 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 17:54:09.688157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:09.694638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:09.694638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:09.694638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:09.702461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:09.703984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:09.723341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:09.724984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 459/908] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:09.731124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:09.842523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00a5de-ed2a-4f94-b601-7f30929b1b74 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:09.878565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:09.879259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:09.879539 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:09.879814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:09.880535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:09.880839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:09.882233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:09.894978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 450/909] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:09.900558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:10.010016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85925b-3999-4dc3-a21d-88ea3da664ed None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:10.044378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:10.045216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:10.045553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:10.045835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:10.053201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:10.054666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:10.069185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:10.070754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 460/910] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:10.076405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:10.174300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee8deb-400e-49e9-9d48-a4e5dae518df None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:10.207234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17343173-949b-493d-bc7b-2699bbd94878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:10.207900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343173-949b-493d-bc7b-2699bbd94878 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:10.208183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343173-949b-493d-bc7b-2699bbd94878 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:10.208463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343173-949b-493d-bc7b-2699bbd94878 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:10.209244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17343173-949b-493d-bc7b-2699bbd94878 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:10.209556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17343173-949b-493d-bc7b-2699bbd94878 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:10.210996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17343173-949b-493d-bc7b-2699bbd94878 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:10.223573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 451/911] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:10.229395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:10.332773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237ea4-b41d-4684-a3f0-f0bfbcac8ee3 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:10.366953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cddf7f-4032-4e6e-9460-d13af7037e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:10.367614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddf7f-4032-4e6e-9460-d13af7037e68 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:10.367897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddf7f-4032-4e6e-9460-d13af7037e68 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:10.368170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddf7f-4032-4e6e-9460-d13af7037e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:10.368997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cddf7f-4032-4e6e-9460-d13af7037e68 None admin] RBAC: Adding query filter params (role.id=2a592ff7598a4baab05dca5d3a8e9209, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=e485723f69be454a99c9a41adf4b5dbb) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:10.369624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cddf7f-4032-4e6e-9460-d13af7037e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:10.371130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cddf7f-4032-4e6e-9460-d13af7037e68 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:10.376984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 461/912] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:10 2022] GET /identity/v3/role_assignments?user.id=e485723f69be454a99c9a41adf4b5dbb&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=2a592ff7598a4baab05dca5d3a8e9209 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:11.462311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758886-3322-431a-b8d8-28252a8905f5 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:11.463311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758886-3322-431a-b8d8-28252a8905f5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:11.463838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758886-3322-431a-b8d8-28252a8905f5 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:11.466229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 452/913] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:11.472135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30340-d671-41fe-b59b-b3ce24f89de9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:11.473034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30340-d671-41fe-b59b-b3ce24f89de9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:11.473502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30340-d671-41fe-b59b-b3ce24f89de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:11.492408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-93e30340-d671-41fe-b59b-b3ce24f89de9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:11.493922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-93e30340-d671-41fe-b59b-b3ce24f89de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:11.566778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 462/914] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:11.585670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a758886-3322-431a-b8d8-28252a8905f5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:11.694904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a758886-3322-431a-b8d8-28252a8905f5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:11.733290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:11.734445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:11.734938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:11.735432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:11.736273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:11.738446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:11.749962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 31 17:54:11.756772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 453/915] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:11.758406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e30340-d671-41fe-b59b-b3ce24f89de9 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:11.856880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e30340-d671-41fe-b59b-b3ce24f89de9 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:11.890601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934f7ec-25d2-4c97-a600-318eff48a9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:11.891290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f7ec-25d2-4c97-a600-318eff48a9cc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:11.891570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f7ec-25d2-4c97-a600-318eff48a9cc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:11.891844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f7ec-25d2-4c97-a600-318eff48a9cc None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:11.892552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934f7ec-25d2-4c97-a600-318eff48a9cc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:11.892856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934f7ec-25d2-4c97-a600-318eff48a9cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:11.894777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934f7ec-25d2-4c97-a600-318eff48a9cc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:11.899944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 463/916] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:11.905622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.011096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e55b4-dae6-4e7e-a93a-eeb38095fa4e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.034234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe931c-677e-48e4-8bb3-b2fedaf09486 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.034517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe931c-677e-48e4-8bb3-b2fedaf09486 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.035051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe931c-677e-48e4-8bb3-b2fedaf09486 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.036998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 464/917] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:54:12.041997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ba91-64df-4452-9bd9-91bfff3c8fcd None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.042239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ba91-64df-4452-9bd9-91bfff3c8fcd None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.042515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ba91-64df-4452-9bd9-91bfff3c8fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.052953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.053964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.054487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.054981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.055926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:12.056443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.058025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.061632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4ec0ba91-64df-4452-9bd9-91bfff3c8fcd None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:12.063119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4ec0ba91-64df-4452-9bd9-91bfff3c8fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:12.069409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 454/918] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Mar 31 17:54:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:12.070953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.135021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 465/919] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:12.136358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9361ae-abff-4d57-b48a-47784c7788f2 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.136696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9361ae-abff-4d57-b48a-47784c7788f2 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.136999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9361ae-abff-4d57-b48a-47784c7788f2 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.138859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 466/920] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:12.144283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7dc4-b8af-40c5-b8b0-71ba89d5283e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.144559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7dc4-b8af-40c5-b8b0-71ba89d5283e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.144909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7dc4-b8af-40c5-b8b0-71ba89d5283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.161530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-18af7dc4-b8af-40c5-b8b0-71ba89d5283e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:12.162754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-18af7dc4-b8af-40c5-b8b0-71ba89d5283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:12.182028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d983d-a3bd-4647-9de0-74bc5410e46a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.214553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.215252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.215515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.215790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.216523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.217891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.238640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 467/921] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:12.238640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7dc4-b8af-40c5-b8b0-71ba89d5283e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.316483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 455/922] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:54:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 17:54:12.317265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.352887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7dc4-b8af-40c5-b8b0-71ba89d5283e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.397452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.398276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.398671 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.399140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.399639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.401036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.413834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 31 17:54:12.415597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 468/923] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:12.422309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.463645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b6f11-3328-4f00-863e-ddedc0299026 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.503430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.504379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.504844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.505320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.506176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.507843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.520865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 31 17:54:12.522469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 456/924] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Mar 31 17:54:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:12.528872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.537825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cb426-3199-43ff-a9d0-1bb3b31be7f4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.581168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.581776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.582054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.582494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.583377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:12.583679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.585185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.590371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 469/925] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:12.598109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.663422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff7bff-0720-4006-bf04-efac81336477 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.703645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1a99c-e3a5-4c40-a694-5be88735fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.704315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1a99c-e3a5-4c40-a694-5be88735fc5d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.704633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1a99c-e3a5-4c40-a694-5be88735fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.704874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1a99c-e3a5-4c40-a694-5be88735fc5d None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.705587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1a99c-e3a5-4c40-a694-5be88735fc5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:12.706535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1a99c-e3a5-4c40-a694-5be88735fc5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.707972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59504d8b-42da-43e3-a692-b46e8aabeca4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.708093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1a99c-e3a5-4c40-a694-5be88735fc5d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.717488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 457/926] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:12.718582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16765bd-37fb-429b-99b5-ff0137dde6d2 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.718896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16765bd-37fb-429b-99b5-ff0137dde6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.719176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16765bd-37fb-429b-99b5-ff0137dde6d2 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.720851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 458/927] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:12.721616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16765bd-37fb-429b-99b5-ff0137dde6d2 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.744978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b91f3c-ccac-4d2a-b0ff-5e90ee47f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.745648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b91f3c-ccac-4d2a-b0ff-5e90ee47f87a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.745923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b91f3c-ccac-4d2a-b0ff-5e90ee47f87a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.746193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b91f3c-ccac-4d2a-b0ff-5e90ee47f87a None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.746925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b91f3c-ccac-4d2a-b0ff-5e90ee47f87a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:12.747230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b91f3c-ccac-4d2a-b0ff-5e90ee47f87a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.748586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b91f3c-ccac-4d2a-b0ff-5e90ee47f87a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.753600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 470/928] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:12.759490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ddaec-14d0-4bee-ba08-896cd25d93bf None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.759774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ddaec-14d0-4bee-ba08-896cd25d93bf None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.760069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ddaec-14d0-4bee-ba08-896cd25d93bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.777080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-321ddaec-14d0-4bee-ba08-896cd25d93bf None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:12.778237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-321ddaec-14d0-4bee-ba08-896cd25d93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:12.821795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16765bd-37fb-429b-99b5-ff0137dde6d2 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.850709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 471/929] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:12.850709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ddaec-14d0-4bee-ba08-896cd25d93bf None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.856176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.856839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.857118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.857391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.858092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:12.858393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.859794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:12.870031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 459/930] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:12.870904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:12.958484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ddaec-14d0-4bee-ba08-896cd25d93bf None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.970335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501fe9-e022-4996-b2f3-9a70c24981ef None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:12.991668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:12.992325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:12.992604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:12.992877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:12.993659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] RBAC: Adding query filter params (interface=public, service_id=8a5bd6410adf454c8fcc4e2256b66e21, region_id=RegionOne) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:12.993966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:12.995594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:13.001507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 472/931] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:54:12 2022] GET /identity/v3/endpoints?service_id=8a5bd6410adf454c8fcc4e2256b66e21&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:13.003406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:13.007175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:13.008111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:13.008392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:13.008701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:13.009395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:13.010774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:13.114784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ab1db-ffed-4580-a604-a5737fa31cf2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:13.138264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:13.139127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:13.139409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:13.139684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:13.150039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:13.151530 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 460/932] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:54:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:13.152549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:13.157572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 31 17:54:13.162978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 473/933] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Mar 31 17:54:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:13.167768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:13.278331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554c232-2ec9-4381-b256-dd6c2e4f9334 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:13.312280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca699-c7da-4921-b70f-791f623cd1d6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:13.314139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:13.314844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:13.315129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:13.315983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:13.316690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:13.318158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:13.325133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 461/934] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:54:13 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 17:54:13.354100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:13.354888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:13.355179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:13.355452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:13.356216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:13.356521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:13.357920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:13.368392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 474/935] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Mar 31 17:54:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:13.374798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:13.486904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f74cd8-e597-4bc2-824c-cd85d8741fff None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:13.524550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:13.525353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:13.525635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:13.525910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:13.538503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:13.540255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:13.558817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:13.560366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 462/936] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:13.565875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:13.669580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276ac0-1085-42d9-b9c8-4f4b9b51db45 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:13.704668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:13.705633 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:13.706110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:13.706726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:13.707620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:13.708116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:13.709710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:13.722291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 475/937] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:13.727752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:13.827392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b9c4-9c8c-42a1-812b-a7f62298db64 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:13.861536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:13.862934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:13.863272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:13.863550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:13.871434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:13.872866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:13.886671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 31 17:54:13.888147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 463/938] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:54:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:13.893811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:14.002180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079164-5c39-4688-8b5d-ad356eb5be73 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:14.038388 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:14.039137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.039473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.039750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.040588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:14.040893 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:14.042307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:14.060792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 476/939] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Mar 31 17:54:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:14.066765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:14.170837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3f08-314c-4aa3-88bb-50aced40f6bd None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:14.207485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:14.208670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.209150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.209628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.221028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:14.222926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:14.240774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:14.242642 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 464/940] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:14.248685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:14.360752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a604-3c46-452e-96c8-3068477c2690 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:14.401939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:14.402624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.402910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.403185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.403913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:14.404209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:14.405568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:14.417726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 477/941] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:14.423231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:14.530361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac627-c77b-4fa7-b35e-f4ea2cbcb36e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:14.566631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d12eb-201e-4cc9-9c77-25f54f388f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:14.567887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d12eb-201e-4cc9-9c77-25f54f388f73 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.568399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d12eb-201e-4cc9-9c77-25f54f388f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.568870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d12eb-201e-4cc9-9c77-25f54f388f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.576889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d12eb-201e-4cc9-9c77-25f54f388f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:14.578704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d12eb-201e-4cc9-9c77-25f54f388f73 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:14.594824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-c05d12eb-201e-4cc9-9c77-25f54f388f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:14.597231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 465/942] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:14.603285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:14.705044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37cbf-2ba2-4b2a-9e6e-63309110fc81 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:14.738431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:14.740520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9167e-6aec-4fad-acd1-62a60d28b2f0 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.741068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9167e-6aec-4fad-acd1-62a60d28b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.741544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9167e-6aec-4fad-acd1-62a60d28b2f0 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.743322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.743617 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.743901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.744493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 466/943] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:54:14.744955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:14.745266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:14.748301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:14.751514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc66503-aa31-4332-9276-39c065ddb138 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.751881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc66503-aa31-4332-9276-39c065ddb138 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.752234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc66503-aa31-4332-9276-39c065ddb138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.761012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 478/944] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:14.766871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:14.774968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2fc66503-aa31-4332-9276-39c065ddb138 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:14.776247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2fc66503-aa31-4332-9276-39c065ddb138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:14.854705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 467/945] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:14.873920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421485-e308-4945-a5ff-0e4b45013c0f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:14.876790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc66503-aa31-4332-9276-39c065ddb138 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:14.913088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:14.913445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:14.913611 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:14.913888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/e485723f69be454a99c9a41adf4b5dbb/roles/2a592ff7598a4baab05dca5d3a8e9209` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:14.916204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=e485723f69be454a99c9a41adf4b5dbb, role_id=2a592ff7598a4baab05dca5d3a8e9209)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:14.917625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:14.979637 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc66503-aa31-4332-9276-39c065ddb138 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:14.998638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 479/946] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:54:14 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/e485723f69be454a99c9a41adf4b5dbb/roles/2a592ff7598a4baab05dca5d3a8e9209 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:54:15.019831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:15.020639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.020920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.021236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.022037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:15.023603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:15.025028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.common [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 31 17:54:15.070395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.sql.core [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 31 17:54:15.070395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 31 17:54:15.070395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [parameters: {'id': '1e698d858e5e46429cbbb1bf2922d4e3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 31 17:54:15.070395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79917) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 31 17:54:15.077492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e698d858e5e46429cbbb1bf2922d4e3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e698d858e5e46429cbbb1bf2922d4e3. Mar 31 17:54:15.079297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 468/947] 10.222.0.58 () {60 vars in 1140 bytes} [Thu Mar 31 17:54:14 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:15.086158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:15.208098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716cac-b9e7-4b67-ae4d-e7517deea038 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:15.246045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70500c3-4ad1-44d2-80b5-31af937fb455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:15.246802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70500c3-4ad1-44d2-80b5-31af937fb455 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.247079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70500c3-4ad1-44d2-80b5-31af937fb455 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.247349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70500c3-4ad1-44d2-80b5-31af937fb455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.255014 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70500c3-4ad1-44d2-80b5-31af937fb455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:15.256465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70500c3-4ad1-44d2-80b5-31af937fb455 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:15.270894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b70500c3-4ad1-44d2-80b5-31af937fb455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:15.272421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 480/948] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:15.278342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:15.387055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c551762-9aa8-49e3-94bd-9e95ff352fe1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:15.421870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e2353-6e28-46e5-bed0-3e969caff7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:15.422930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2353-6e28-46e5-bed0-3e969caff7db None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.423391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2353-6e28-46e5-bed0-3e969caff7db None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.423893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2353-6e28-46e5-bed0-3e969caff7db None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.424881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e2353-6e28-46e5-bed0-3e969caff7db None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:15.425378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e2353-6e28-46e5-bed0-3e969caff7db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:15.427569 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e2353-6e28-46e5-bed0-3e969caff7db None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:15.451992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 469/949] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:54:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:15.569621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb2ec-4339-43ea-9d8b-1d420cfda92d None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.569814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb2ec-4339-43ea-9d8b-1d420cfda92d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.570090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb2ec-4339-43ea-9d8b-1d420cfda92d None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.572233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 481/950] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:15.578066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c25a55-2886-49ef-b766-3de1ebd3f3d6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.578989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c25a55-2886-49ef-b766-3de1ebd3f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.579442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c25a55-2886-49ef-b766-3de1ebd3f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.600352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-43c25a55-2886-49ef-b766-3de1ebd3f3d6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:15.602228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-43c25a55-2886-49ef-b766-3de1ebd3f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:15.679317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 470/951] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:15.702299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb2ec-4339-43ea-9d8b-1d420cfda92d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:15.809946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb2ec-4339-43ea-9d8b-1d420cfda92d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:15.825222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759468-ffbe-43ea-90c7-c9060a51e53a None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.825534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759468-ffbe-43ea-90c7-c9060a51e53a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.825717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759468-ffbe-43ea-90c7-c9060a51e53a None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.827802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 471/952] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:54:15.833854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd7c3-cbd9-4729-8e81-ce61d8d809c7 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.834128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd7c3-cbd9-4729-8e81-ce61d8d809c7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.834396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd7c3-cbd9-4729-8e81-ce61d8d809c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.847190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:15.848297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:15.848774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:15.849331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] PATH_INFO: `/v3/services/compute` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:15.850184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:15.851572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-198fd7c3-cbd9-4729-8e81-ce61d8d809c7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:15.851996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:15.852762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-198fd7c3-cbd9-4729-8e81-ce61d8d809c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:15.864250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 31 17:54:15.866054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 482/953] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:15.873354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:15.938696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 472/954] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:15.963004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd7c3-cbd9-4729-8e81-ce61d8d809c7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:15.986785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab422f4-bc86-4c30-8027-d59a3ec99b7b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:16.026566 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:16.027296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:16.027581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:16.027855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:16.028560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:16.028867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:16.030223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:16.036578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 483/955] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:54:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:16.042074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:16.086657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd7c3-cbd9-4729-8e81-ce61d8d809c7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:16.121293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:16.122093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:16.122369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:16.122658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:16.123322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:16.124695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:16.136397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 31 17:54:16.142585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 473/956] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:16.144199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:16.154717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b852b0-251e-46ec-ae8d-1c1f46eaaba2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:16.194499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:16.195291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:16.195575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:16.195953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:16.197002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:16.197305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:16.199029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:16.210659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 484/957] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:54:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:16.270212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1017-a3a8-4222-a81f-1e461fc6d12d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:16.307313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:16.307992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:16.308269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:16.308539 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:16.309255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:16.309557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:16.310979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:16.317818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 474/958] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:16.325975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:16.434699 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d9e1-1e67-4570-9fdd-27b0e274e5c1 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:16.469172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1ffec-3e62-4daa-a07c-2e42f1d109bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:16.470187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1ffec-3e62-4daa-a07c-2e42f1d109bc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:16.470696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1ffec-3e62-4daa-a07c-2e42f1d109bc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:16.471193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1ffec-3e62-4daa-a07c-2e42f1d109bc None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:16.472263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1ffec-3e62-4daa-a07c-2e42f1d109bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:16.472772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1ffec-3e62-4daa-a07c-2e42f1d109bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:16.474448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1ffec-3e62-4daa-a07c-2e42f1d109bc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:16.479962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 485/959] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:16.485784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:16.589231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65816-4d81-4e65-b254-5546c45afaed None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:16.625346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e764a91-e7ba-47aa-ba58-f1b272fcf62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:16.626005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764a91-e7ba-47aa-ba58-f1b272fcf62a None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:16.626281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764a91-e7ba-47aa-ba58-f1b272fcf62a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:16.626554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764a91-e7ba-47aa-ba58-f1b272fcf62a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:16.627339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e764a91-e7ba-47aa-ba58-f1b272fcf62a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:16.628914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e764a91-e7ba-47aa-ba58-f1b272fcf62a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:16.728589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 475/960] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:54:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:17.420135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074fc6-a5ba-4650-a96c-9afca83eebaf None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:17.420713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074fc6-a5ba-4650-a96c-9afca83eebaf None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:17.420713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074fc6-a5ba-4650-a96c-9afca83eebaf None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:17.422635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 486/961] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:17.428733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3262-afc6-44f5-8510-e9bb9d65e93a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:17.429022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3262-afc6-44f5-8510-e9bb9d65e93a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:17.432951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3262-afc6-44f5-8510-e9bb9d65e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:17.446702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-225b3262-afc6-44f5-8510-e9bb9d65e93a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:17.448230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-225b3262-afc6-44f5-8510-e9bb9d65e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:17.529493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 476/962] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:17.553835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f074fc6-a5ba-4650-a96c-9afca83eebaf None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:17.657850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f074fc6-a5ba-4650-a96c-9afca83eebaf None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:17.692361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:17.693483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:17.693979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:17.694449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:17.705073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:17.712739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 31 17:54:17.714452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 487/963] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Mar 31 17:54:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:17.723721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3262-afc6-44f5-8510-e9bb9d65e93a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:17.824950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3262-afc6-44f5-8510-e9bb9d65e93a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:17.860779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd96389-73cd-4043-add5-a08bed5d08d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:17.861870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd96389-73cd-4043-add5-a08bed5d08d2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:17.862433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd96389-73cd-4043-add5-a08bed5d08d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:17.862991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd96389-73cd-4043-add5-a08bed5d08d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:17.864113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd96389-73cd-4043-add5-a08bed5d08d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:17.864640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd96389-73cd-4043-add5-a08bed5d08d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:17.866210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd96389-73cd-4043-add5-a08bed5d08d2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:17.876032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 477/964] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Mar 31 17:54:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:17.882271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:17.891452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c809-da30-4202-915a-98bc05628937 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:17.891800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c809-da30-4202-915a-98bc05628937 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:17.892023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c809-da30-4202-915a-98bc05628937 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:17.895951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 478/965] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:17.901329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0841c-60ad-4f95-b5c1-7edd3b5b973a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:17.901678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0841c-60ad-4f95-b5c1-7edd3b5b973a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:17.901866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0841c-60ad-4f95-b5c1-7edd3b5b973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:17.919607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-94c0841c-60ad-4f95-b5c1-7edd3b5b973a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:17.920712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-94c0841c-60ad-4f95-b5c1-7edd3b5b973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:17.989242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294336a2-210f-4892-a644-90cc76e3f9d5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:17.995956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 479/966] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:18.016351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0841c-60ad-4f95-b5c1-7edd3b5b973a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.026740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.027847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.028341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.028808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.039847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.041561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.070125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:18.071950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 488/967] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:18.077497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.118049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0841c-60ad-4f95-b5c1-7edd3b5b973a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.153107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.153790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.154073 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.154348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.155082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.156517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.179313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4e05-441d-4844-aea4-81adad383c14 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.207604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.sql.core [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 31 17:54:18.207604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 31 17:54:18.207604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [parameters: {'user_id': '23802c9a760e420ca3f3517c00c1dfce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 31 17:54:18.207604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79917) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 31 17:54:18.213871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.214597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.214907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.215232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.215947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 31 17:54:18.216052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:18.216310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.217778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.223146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 480/968] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Mar 31 17:54:18 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:18.224665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.238695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 489/969] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:18.242201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.366952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef10d5-2091-4410-8dcc-80015d8db57a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.368064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436501c-8cfe-47b7-8a09-ab3ac4e366b9 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.401866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.403091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.403578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.404062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.409936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.410778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.411062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.411337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.414297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.416187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.420478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.421906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.432321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 31 17:54:18.434074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 481/970] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:54:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:18.437254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 31 17:54:18.443516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 490/971] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:54:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:18.444877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.445958 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.547843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06401b13-7c55-4817-9b02-84987e4c369b None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.549759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955d414-d545-43ba-88ee-9c707bfccb15 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.582406 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.583220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.583535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.584002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.584958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:18.585261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.586815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.587223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a561-c467-4ec9-8b0a-c169597e7f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.588131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a561-c467-4ec9-8b0a-c169597e7f20 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.588627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a561-c467-4ec9-8b0a-c169597e7f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.589109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a561-c467-4ec9-8b0a-c169597e7f20 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.590120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a561-c467-4ec9-8b0a-c169597e7f20 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:18.590647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a561-c467-4ec9-8b0a-c169597e7f20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.592271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a561-c467-4ec9-8b0a-c169597e7f20 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.614237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 482/972] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Mar 31 17:54:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:18.615793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.640156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 491/973] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Mar 31 17:54:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:18.648328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023ad0-3ed3-4836-8bd4-063d2fd3934e None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.648694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023ad0-3ed3-4836-8bd4-063d2fd3934e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.648891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023ad0-3ed3-4836-8bd4-063d2fd3934e None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.651075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 492/974] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:18.657770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8a75-c86c-40bd-8bfc-e0be8040e088 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.658292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8a75-c86c-40bd-8bfc-e0be8040e088 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.658748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8a75-c86c-40bd-8bfc-e0be8040e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.677435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b51a8a75-c86c-40bd-8bfc-e0be8040e088 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:18.679015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b51a8a75-c86c-40bd-8bfc-e0be8040e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:18.762633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5df2b-d2a0-4786-81fe-c0edacbe0a2a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.763818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 493/975] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:18.782087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a8a75-c86c-40bd-8bfc-e0be8040e088 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:18.796107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.796815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.797097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.797370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.872727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.874138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.896809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a8a75-c86c-40bd-8bfc-e0be8040e088 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:18.945437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af96c3-a54f-41f9-82c8-81d83de9d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:18.946122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af96c3-a54f-41f9-82c8-81d83de9d519 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:18.946399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af96c3-a54f-41f9-82c8-81d83de9d519 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:18.946689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af96c3-a54f-41f9-82c8-81d83de9d519 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:18.947625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af96c3-a54f-41f9-82c8-81d83de9d519 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:18.949641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af96c3-a54f-41f9-82c8-81d83de9d519 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:18.991231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 483/976] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 31 17:54:18.997163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.030971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 494/977] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:54:18 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:19.087112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315875-8da5-4e29-86df-67bf5776295c None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.087406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315875-8da5-4e29-86df-67bf5776295c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.087854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315875-8da5-4e29-86df-67bf5776295c None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.089774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 495/978] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:19.095590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdcfe6-afd5-4fd0-b748-cc323593d47b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.095872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdcfe6-afd5-4fd0-b748-cc323593d47b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.096150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdcfe6-afd5-4fd0-b748-cc323593d47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.113714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b7cdcfe6-afd5-4fd0-b748-cc323593d47b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:19.114976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b7cdcfe6-afd5-4fd0-b748-cc323593d47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:19.116318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5badf6-05a9-454f-bcbf-ae8491394e7f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.162824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.163552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.163838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.164112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.175688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.177224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.191114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 496/979] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:19.194975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:19.196411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 484/980] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:19.201933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdcfe6-afd5-4fd0-b748-cc323593d47b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.208556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.305569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdcfe6-afd5-4fd0-b748-cc323593d47b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.311601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b96c63-f2b2-4838-9c6a-8afee8c69b4c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.339117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.339778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.340056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.340332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.341036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:19.341392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.342695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.344442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.345240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.345518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.345849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.346507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.348595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.358666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 497/981] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:19.359634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.359915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 31 17:54:19.361211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 485/982] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:19.367610 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.460531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc538e03-5f4a-45d7-b513-d69c1499c1a3 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.469568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098689-f51e-4ec8-b636-edbad2f567fc None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.493123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.493911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.494194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.494473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.501239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.502379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.502690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.503201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.503400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.503677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.504442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:19.504756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.506098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.515399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 486/983] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:19.516268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:19.516390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.517547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 498/984] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:19.524109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.615518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a50ab-38be-443d-b821-14ee7978a2ad None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.624828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662c488-cf41-4bdb-a04d-072bfde3fa18 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.649120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.649814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.650102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.650386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.651122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:19.651431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.652819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.657488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 487/985] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:19.663835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.668961 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.669706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.670056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.670397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.671346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:19.671659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.673512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.687363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 499/986] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:19.693352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.760259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d489-f9b9-461d-bcc5-e7ea90f019e0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.792590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2d702-5e5a-4c56-9612-e537226eefad None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.793550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.794213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.794492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.794816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.795612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] RBAC: Adding query filter params (interface=admin, service_id=8a5bd6410adf454c8fcc4e2256b66e21, region_id=RegionOne) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:19.795921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.797276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.806845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 488/987] 10.222.0.58 () {56 vars in 1249 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/endpoints?service_id=8a5bd6410adf454c8fcc4e2256b66e21&interface=admin®ion_id=RegionOne => generated 193 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:19.808440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:19.833139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127ad8-030d-49bc-b1af-75a8d1045b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.833806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127ad8-030d-49bc-b1af-75a8d1045b7e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.834090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127ad8-030d-49bc-b1af-75a8d1045b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.834370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127ad8-030d-49bc-b1af-75a8d1045b7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.835261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127ad8-030d-49bc-b1af-75a8d1045b7e None admin] RBAC: Adding query filter params (role.id=2a592ff7598a4baab05dca5d3a8e9209, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=e485723f69be454a99c9a41adf4b5dbb) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:19.835579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127ad8-030d-49bc-b1af-75a8d1045b7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.837026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127ad8-030d-49bc-b1af-75a8d1045b7e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.845183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 500/988] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/role_assignments?user.id=e485723f69be454a99c9a41adf4b5dbb&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=2a592ff7598a4baab05dca5d3a8e9209 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:19.916315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eae73-af84-48df-8332-a28d5d87feb6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:19.951029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962c7cc-f018-43b4-becc-c6f3b0bf2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:19.951712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c7cc-f018-43b4-becc-c6f3b0bf2639 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:19.951987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c7cc-f018-43b4-becc-c6f3b0bf2639 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:19.952257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c7cc-f018-43b4-becc-c6f3b0bf2639 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:19.952943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962c7cc-f018-43b4-becc-c6f3b0bf2639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:19.954324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962c7cc-f018-43b4-becc-c6f3b0bf2639 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:19.962036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 489/989] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:54:19 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 17:54:21.364028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a161dd-d710-46e0-a832-7399764cbf94 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:21.364532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a161dd-d710-46e0-a832-7399764cbf94 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:21.364532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a161dd-d710-46e0-a832-7399764cbf94 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:21.366307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 501/990] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:21.372138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa52f5-6e76-4763-a31c-2c8b951c0f58 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:21.372565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa52f5-6e76-4763-a31c-2c8b951c0f58 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:21.372712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa52f5-6e76-4763-a31c-2c8b951c0f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:21.390236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d3fa52f5-6e76-4763-a31c-2c8b951c0f58 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:21.391769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d3fa52f5-6e76-4763-a31c-2c8b951c0f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:21.457300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 490/991] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:21.479643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a161dd-d710-46e0-a832-7399764cbf94 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:21.580137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a161dd-d710-46e0-a832-7399764cbf94 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:21.614019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:21.615133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:21.615565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:21.615985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:21.616790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:21.618303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:21.630222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 31 17:54:21.631894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 502/992] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:21.637391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa52f5-6e76-4763-a31c-2c8b951c0f58 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:21.740225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa52f5-6e76-4763-a31c-2c8b951c0f58 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:21.773707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:21.774472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:21.774694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:21.774974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:21.775677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:21.775983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:21.777346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:21.787248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 491/993] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:54:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:21.788692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:21.883479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70695f-537f-4157-9e48-a43acfbaa731 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:21.922600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:21.923308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:21.923584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:21.923854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:21.924569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:21.924870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:21.926406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:21.936440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 503/994] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:54:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:21.937693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.040913 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69878e60-08db-481d-9caf-ca062f026f94 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.080574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2ef22-ddce-4e84-bca7-afb5a403628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.082231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2ef22-ddce-4e84-bca7-afb5a403628d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.082741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2ef22-ddce-4e84-bca7-afb5a403628d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.083198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2ef22-ddce-4e84-bca7-afb5a403628d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.084283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2ef22-ddce-4e84-bca7-afb5a403628d None admin] RBAC: Adding query filter params (interface=public, service_id=559fdae96ba140aa8f7c6c0b70503372, region_id=RegionOne) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:22.084777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2ef22-ddce-4e84-bca7-afb5a403628d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.086399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2ef22-ddce-4e84-bca7-afb5a403628d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.095905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 492/995] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:54:21 2022] GET /identity/v3/endpoints?service_id=559fdae96ba140aa8f7c6c0b70503372&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:22.097359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.192139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b4cca-a3a2-4007-93b9-704f15711705 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.223907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd69076-5a5c-4647-94d8-4253f120f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.224572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69076-5a5c-4647-94d8-4253f120f173 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.224854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69076-5a5c-4647-94d8-4253f120f173 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.225123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69076-5a5c-4647-94d8-4253f120f173 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.225800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd69076-5a5c-4647-94d8-4253f120f173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.227184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd69076-5a5c-4647-94d8-4253f120f173 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.233520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 504/996] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:54:22 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 17:54:22.270065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e09d-4e24-4bb9-8204-91537ec666f3 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.270387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e09d-4e24-4bb9-8204-91537ec666f3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.270740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e09d-4e24-4bb9-8204-91537ec666f3 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.272768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 493/997] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:22.277927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84211-d81f-4bd7-b5ae-c8a3c59c5dc9 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.278221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84211-d81f-4bd7-b5ae-c8a3c59c5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.278314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be591b4c-5d3c-48a1-ac09-f3cf5ba345c5 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.278494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84211-d81f-4bd7-b5ae-c8a3c59c5dc9 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.278629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be591b4c-5d3c-48a1-ac09-f3cf5ba345c5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.278877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be591b4c-5d3c-48a1-ac09-f3cf5ba345c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.280320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 505/998] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:22.286674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61302c0-16d1-4cf8-a0bc-02faa076e7ae None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.286967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61302c0-16d1-4cf8-a0bc-02faa076e7ae None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.287253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61302c0-16d1-4cf8-a0bc-02faa076e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.296794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-be591b4c-5d3c-48a1-ac09-f3cf5ba345c5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:22.298005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-be591b4c-5d3c-48a1-ac09-f3cf5ba345c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:22.305774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d61302c0-16d1-4cf8-a0bc-02faa076e7ae None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:22.307019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d61302c0-16d1-4cf8-a0bc-02faa076e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:22.371972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 494/999] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:22.388370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 506/1000] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:22.396421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be591b4c-5d3c-48a1-ac09-f3cf5ba345c5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.412491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61302c0-16d1-4cf8-a0bc-02faa076e7ae None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.496583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be591b4c-5d3c-48a1-ac09-f3cf5ba345c5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.510243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61302c0-16d1-4cf8-a0bc-02faa076e7ae None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.529825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.530652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.530939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.531215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.531867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.533211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.544348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 31 17:54:22.545232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.545534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 495/1001] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Mar 31 17:54:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:22.546435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.546863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.547145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.547831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.549219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.552144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.561364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 31 17:54:22.562719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 507/1002] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Mar 31 17:54:22 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:22.569138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.651052 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50235969-cf9f-441f-8e4c-eb9e71cf943f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.668358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751c921-111e-4491-96d9-aa57410fd2c6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.684389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.685057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.685341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.685619 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.686322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:22.686658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.688040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.693372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 496/1003] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:22.698771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.702046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.702741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.703020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.703295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.704002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] RBAC: Adding query filter params (name=image) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:22.704309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.705654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.715480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 508/1004] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:22.716450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.797861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac261f-ac6e-43a3-836e-c2a0922061b2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.811237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc795839-4370-4025-8b89-8a8222d2c3ff None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.830853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.832113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.832712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.832831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.833478 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:22.833786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.835214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.840050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 497/1005] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Mar 31 17:54:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:22.845548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:22.851389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32559b-5151-4556-bf7c-d14e43dac7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.852079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32559b-5151-4556-bf7c-d14e43dac7d1 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.852370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32559b-5151-4556-bf7c-d14e43dac7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.852648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32559b-5151-4556-bf7c-d14e43dac7d1 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.853359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32559b-5151-4556-bf7c-d14e43dac7d1 None admin] RBAC: Adding query filter params (type=image) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:22.853668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32559b-5151-4556-bf7c-d14e43dac7d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.855065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32559b-5151-4556-bf7c-d14e43dac7d1 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:22.867612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 509/1006] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:22.949441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c894be-f4c1-4cd5-8871-4fdc92b3ed11 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:22.984588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2581-302c-421a-a363-da013641e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:22.985259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2581-302c-421a-a363-da013641e192 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:22.985547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2581-302c-421a-a363-da013641e192 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:22.985822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2581-302c-421a-a363-da013641e192 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:22.986574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b2581-302c-421a-a363-da013641e192 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:22.988918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b2581-302c-421a-a363-da013641e192 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:23.066308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 498/1007] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:54:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:24.572023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdf370-571d-49d5-8999-8da42d76da9f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:24.572573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdf370-571d-49d5-8999-8da42d76da9f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:24.572573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdf370-571d-49d5-8999-8da42d76da9f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:24.574477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 510/1008] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:24.579503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b382fe-1138-46fd-934d-9c0080768bc0 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:24.579922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b382fe-1138-46fd-934d-9c0080768bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:24.580084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b382fe-1138-46fd-934d-9c0080768bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:24.599069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-67b382fe-1138-46fd-934d-9c0080768bc0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:24.600276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-67b382fe-1138-46fd-934d-9c0080768bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:24.674649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 499/1009] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:24.695385 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdf370-571d-49d5-8999-8da42d76da9f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:24.800763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdf370-571d-49d5-8999-8da42d76da9f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:24.837137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:24.837853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:24.838134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:24.838408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:24.839098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:24.840455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:24.851765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 31 17:54:24.857644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 511/1010] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:24.859206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b382fe-1138-46fd-934d-9c0080768bc0 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:24.957625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b382fe-1138-46fd-934d-9c0080768bc0 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:24.992623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc36e-42a3-45b0-9b82-e81a4251786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:24.993302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc36e-42a3-45b0-9b82-e81a4251786e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:24.993660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc36e-42a3-45b0-9b82-e81a4251786e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:24.993893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc36e-42a3-45b0-9b82-e81a4251786e None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:24.994649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc36e-42a3-45b0-9b82-e81a4251786e None admin] RBAC: Adding query filter params (name=compute) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:24.994949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc36e-42a3-45b0-9b82-e81a4251786e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:24.996566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc36e-42a3-45b0-9b82-e81a4251786e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:25.007127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 500/1011] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:54:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:25.008398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:25.118204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7fa00-e0f4-40d0-b8d5-cbb8d0d1bba5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:25.151394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373efe-abbc-4590-9b70-f75727167fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:25.152108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373efe-abbc-4590-9b70-f75727167fe3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.152395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373efe-abbc-4590-9b70-f75727167fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.152671 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373efe-abbc-4590-9b70-f75727167fe3 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.153427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373efe-abbc-4590-9b70-f75727167fe3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:25.153735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373efe-abbc-4590-9b70-f75727167fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:25.155121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373efe-abbc-4590-9b70-f75727167fe3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:25.161364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f56da2-ea24-4046-a44e-3724c4ff65a8 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.161654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f56da2-ea24-4046-a44e-3724c4ff65a8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.161931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f56da2-ea24-4046-a44e-3724c4ff65a8 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.163886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 501/1012] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:25.166203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 512/1013] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Mar 31 17:54:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:25.166317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f56da2-ea24-4046-a44e-3724c4ff65a8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:25.168683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bb14a-ddec-4882-8d7e-82df32da98af None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.168977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bb14a-ddec-4882-8d7e-82df32da98af None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.169258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bb14a-ddec-4882-8d7e-82df32da98af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.187692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-210bb14a-ddec-4882-8d7e-82df32da98af None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:25.188862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-210bb14a-ddec-4882-8d7e-82df32da98af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:25.253148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 513/1014] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:25.274038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f56da2-ea24-4046-a44e-3724c4ff65a8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:25.277147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bb14a-ddec-4882-8d7e-82df32da98af None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:25.306768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc829e-e0b9-4417-b39a-1aad9935a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:25.307426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc829e-e0b9-4417-b39a-1aad9935a292 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.307706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc829e-e0b9-4417-b39a-1aad9935a292 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.307972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc829e-e0b9-4417-b39a-1aad9935a292 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.308711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc829e-e0b9-4417-b39a-1aad9935a292 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:25.310089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc829e-e0b9-4417-b39a-1aad9935a292 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:25.374116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bb14a-ddec-4882-8d7e-82df32da98af None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:25.387208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 502/1015] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:54:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:25.416008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd31f8-e6f4-4fd7-8b5a-704c33e03ffe None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.416332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd31f8-e6f4-4fd7-8b5a-704c33e03ffe None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.416600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd31f8-e6f4-4fd7-8b5a-704c33e03ffe None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.418845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 503/1016] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:54:25.424341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f2e2-3059-4fc4-b843-cfcb2076f914 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.424631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f2e2-3059-4fc4-b843-cfcb2076f914 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.424909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f2e2-3059-4fc4-b843-cfcb2076f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.434687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:25.435361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.435640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.435920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.436635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:25.438016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:25.444656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b5f8f2e2-3059-4fc4-b843-cfcb2076f914 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:25.445895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b5f8f2e2-3059-4fc4-b843-cfcb2076f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:25.512583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 514/1017] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:54:25 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 17:54:25.533289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 504/1018] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:25.558853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:25.674035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d4bc8-0d53-4997-b115-7fdb9aa21e6d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:25.712119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25060bfb-33f1-4d92-abba-ced04c0abf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:25.713098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060bfb-33f1-4d92-abba-ced04c0abf92 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.713378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060bfb-33f1-4d92-abba-ced04c0abf92 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.713646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060bfb-33f1-4d92-abba-ced04c0abf92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.714958 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25060bfb-33f1-4d92-abba-ced04c0abf92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:25.718828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25060bfb-33f1-4d92-abba-ced04c0abf92 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:25.718828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 515/1019] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:25.725218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f2e2-3059-4fc4-b843-cfcb2076f914 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:25.828886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f2e2-3059-4fc4-b843-cfcb2076f914 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:25.862359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32881be-9a01-40b8-a01a-dd5e5a058b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:25.863115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32881be-9a01-40b8-a01a-dd5e5a058b19 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:25.864058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32881be-9a01-40b8-a01a-dd5e5a058b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:25.864337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32881be-9a01-40b8-a01a-dd5e5a058b19 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:25.865063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32881be-9a01-40b8-a01a-dd5e5a058b19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:25.866505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32881be-9a01-40b8-a01a-dd5e5a058b19 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:25.954715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 505/1020] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:54:25 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:27.843337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6206f1-8cda-4df0-826a-51c8bbc8f499 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:27.843868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6206f1-8cda-4df0-826a-51c8bbc8f499 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:27.843868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6206f1-8cda-4df0-826a-51c8bbc8f499 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:27.845627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 516/1021] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:27.851183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447656c-3a86-4acc-841c-6b7e8dadba3d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:27.851607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447656c-3a86-4acc-841c-6b7e8dadba3d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:27.851746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447656c-3a86-4acc-841c-6b7e8dadba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:27.854287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bddea-989f-41fd-a5e5-3f4fac66be11 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:27.854817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bddea-989f-41fd-a5e5-3f4fac66be11 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:27.855281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bddea-989f-41fd-a5e5-3f4fac66be11 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:27.857101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 517/1022] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:27.862310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b05eb-046a-4045-b1f7-fae9e2739e44 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:27.862600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b05eb-046a-4045-b1f7-fae9e2739e44 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:27.863440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b05eb-046a-4045-b1f7-fae9e2739e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:27.869930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7447656c-3a86-4acc-841c-6b7e8dadba3d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:27.871393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7447656c-3a86-4acc-841c-6b7e8dadba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:27.880686 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-003b05eb-046a-4045-b1f7-fae9e2739e44 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:27.881889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-003b05eb-046a-4045-b1f7-fae9e2739e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:27.938323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 506/1023] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:27.958983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 518/1024] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:27.963005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447656c-3a86-4acc-841c-6b7e8dadba3d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:27.975765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b05eb-046a-4045-b1f7-fae9e2739e44 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.064298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447656c-3a86-4acc-841c-6b7e8dadba3d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.078764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b05eb-046a-4045-b1f7-fae9e2739e44 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.098226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.099413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.099880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.100356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.110601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:28.111354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.112137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.112415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.112800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.113486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.114872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.119764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 31 17:54:28.121409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 507/1025] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Mar 31 17:54:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:28.125543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 31 17:54:28.126933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 519/1026] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Mar 31 17:54:27 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:28.127237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.133173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.225216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b61e5-9055-4b02-b166-5092905fb55c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.229226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7103d8-4190-4a91-8d50-651dad8cd8e6 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.259328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.260344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.260993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.261524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.262090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.262764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:28.262884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.263081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.263355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.263773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.264055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] RBAC: Adding query filter params (name=image) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:28.264356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.265705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.265915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.271531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 520/1027] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:28.276121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 508/1028] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:28.276785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.281460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.380187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bccc2-1b40-4d58-9946-22a97e4d1726 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.385214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c82b9-c33e-4ff1-a882-1e2bc2822d80 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.412473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b65c8-8900-44a0-ab22-4bca824d9e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.413166 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b65c8-8900-44a0-ab22-4bca824d9e62 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.413448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b65c8-8900-44a0-ab22-4bca824d9e62 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.413725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b65c8-8900-44a0-ab22-4bca824d9e62 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.414453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b65c8-8900-44a0-ab22-4bca824d9e62 None admin] RBAC: Adding query filter params (type=image) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:28.414796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b65c8-8900-44a0-ab22-4bca824d9e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.416349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b65c8-8900-44a0-ab22-4bca824d9e62 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.416908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ecfe2-ea7f-4219-ac88-031c32f90a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.417693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ecfe2-ea7f-4219-ac88-031c32f90a8c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.417973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ecfe2-ea7f-4219-ac88-031c32f90a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.418245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ecfe2-ea7f-4219-ac88-031c32f90a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.421095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 521/1029] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:28.422379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5153-2218-4892-8d3b-5c3a0b0fd8fd None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.422704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5153-2218-4892-8d3b-5c3a0b0fd8fd None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.422986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5153-2218-4892-8d3b-5c3a0b0fd8fd None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.424855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 522/1030] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:28.429489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ecfe2-ea7f-4219-ac88-031c32f90a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.430232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5153-2218-4892-8d3b-5c3a0b0fd8fd None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.430953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ecfe2-ea7f-4219-ac88-031c32f90a8c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.447679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-230ecfe2-ea7f-4219-ac88-031c32f90a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:28.448883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 509/1031] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:28.450039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54711d-49d5-4802-8ef5-c7927f14fbda None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.450326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54711d-49d5-4802-8ef5-c7927f14fbda None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.450602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54711d-49d5-4802-8ef5-c7927f14fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.467698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-cc54711d-49d5-4802-8ef5-c7927f14fbda None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:28.468884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cc54711d-49d5-4802-8ef5-c7927f14fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:28.530374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5153-2218-4892-8d3b-5c3a0b0fd8fd None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.532313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 510/1032] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:28.533176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54711d-49d5-4802-8ef5-c7927f14fbda None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.564830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.565486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.565768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.566037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.567162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] RBAC: Adding query filter params (interface=public, service_id=d39f58d3142b46c2829f2abe3191f35b, region_id=RegionOne) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:28.567470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.568822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.573813 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 523/1033] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/endpoints?service_id=d39f58d3142b46c2829f2abe3191f35b&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:28.574421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.637972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54711d-49d5-4802-8ef5-c7927f14fbda None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.667282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de2e67-1750-4058-bdbc-c423778c4c71 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.669543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.670203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.670482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.670778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.671491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:28.671792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.673149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.684701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 511/1034] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:28.685485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.701046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.701855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.702138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.702414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.703622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.705062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.706675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 524/1035] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:28.707611 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.779134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e19a2-9e1c-4e30-ba01-3c0f9e748adb None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.800151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96180caa-9537-41b0-9720-ebdd01e7861c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.811673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.812329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.812609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.812880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.813550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.814915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.821644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 512/1036] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/services => generated 1957 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 17:54:28.822307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.838359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.839212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.839499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.839771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.848465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.849963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.865610 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:54:28.867122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 525/1037] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:28.873026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:28.932148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b87a-a246-4493-8dc1-0342136a24c8 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:28.966461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:28.967167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:28.967445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:28.967802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:28.968430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:28.969871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:28.976002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73edb56-169b-4283-8d85-ae5701742d5e None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:29.012233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:29.012935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:29.013221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:29.013508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:29.014378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:29.014718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:29.016142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:29.034138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 526/1038] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:54:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:29.040624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:29.048919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 513/1039] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:54:28 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:29.151036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b58e5-503b-49dc-960d-a7c7f8a79a6a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:29.187030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:29.187618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:29.187901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:29.188167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:29.258389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:29.259900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:29.361496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 527/1040] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 31 17:54:29.367086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:29.464704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d5314-d9ee-48fb-a587-b4c1667a082c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:29.497441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77587635-3f80-4663-b46c-850b4593466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:29.498238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77587635-3f80-4663-b46c-850b4593466c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:29.498521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77587635-3f80-4663-b46c-850b4593466c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:29.498824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77587635-3f80-4663-b46c-850b4593466c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:29.509904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77587635-3f80-4663-b46c-850b4593466c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:29.511373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77587635-3f80-4663-b46c-850b4593466c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:29.527563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-77587635-3f80-4663-b46c-850b4593466c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:29.533443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 514/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:29.535486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:29.631692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223e8b9-9050-4b32-a737-a7b832ef9a2c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:29.665360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:29.666029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:29.666314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:29.666592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:29.667332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:29.667639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:29.669003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:29.686914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 528/1042] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:29.691966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77587635-3f80-4663-b46c-850b4593466c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:29.797027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77587635-3f80-4663-b46c-850b4593466c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:29.831039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:29.831898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:29.832347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:29.832770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:29.839606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:29.841058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:29.855096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:29.856471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 515/1043] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:29.862023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:29.964453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5cba8-18ea-42a7-99a9-d42b383ff5e0 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:29.997381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c273b-239c-4cf5-bfe4-91abb37a0ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:29.998032 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c273b-239c-4cf5-bfe4-91abb37a0ac8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:29.998316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c273b-239c-4cf5-bfe4-91abb37a0ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:29.998586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c273b-239c-4cf5-bfe4-91abb37a0ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:29.999388 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c273b-239c-4cf5-bfe4-91abb37a0ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:29.999690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c273b-239c-4cf5-bfe4-91abb37a0ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:30.001092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c273b-239c-4cf5-bfe4-91abb37a0ac8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:30.013037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 529/1044] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:30.018905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:30.122771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bae79-ae3d-4427-9a54-e089c8ba3f91 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:30.154977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600abdd7-02f1-4014-8b4f-aa4d9556e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:30.155632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abdd7-02f1-4014-8b4f-aa4d9556e05b None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:30.155910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abdd7-02f1-4014-8b4f-aa4d9556e05b None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:30.156183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abdd7-02f1-4014-8b4f-aa4d9556e05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:30.157000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600abdd7-02f1-4014-8b4f-aa4d9556e05b None admin] RBAC: Adding query filter params (role.id=2a592ff7598a4baab05dca5d3a8e9209, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7e46af6e41bb45c08e5a6b9fd596e4f1) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:30.157312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600abdd7-02f1-4014-8b4f-aa4d9556e05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:30.158761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600abdd7-02f1-4014-8b4f-aa4d9556e05b None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:30.170647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 516/1045] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:30 2022] GET /identity/v3/role_assignments?user.id=7e46af6e41bb45c08e5a6b9fd596e4f1&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=2a592ff7598a4baab05dca5d3a8e9209 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:31.121630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df0eb-589b-4da0-be0d-ee5cc6f5cdeb None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.122145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df0eb-589b-4da0-be0d-ee5cc6f5cdeb None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.122145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df0eb-589b-4da0-be0d-ee5cc6f5cdeb None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.124091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 530/1046] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:31.129509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33580-0cfa-47be-931d-a716cba91028 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.130030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33580-0cfa-47be-931d-a716cba91028 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.130030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a33580-0cfa-47be-931d-a716cba91028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.147135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e2a33580-0cfa-47be-931d-a716cba91028 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:31.148298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e2a33580-0cfa-47be-931d-a716cba91028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:31.212349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 517/1047] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:31.234458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df0eb-589b-4da0-be0d-ee5cc6f5cdeb None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:31.334311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df0eb-589b-4da0-be0d-ee5cc6f5cdeb None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:31.367087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd5f93-68ea-4ac9-a4ae-d9478a5f1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:31.367864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd5f93-68ea-4ac9-a4ae-d9478a5f1eaa None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.368139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd5f93-68ea-4ac9-a4ae-d9478a5f1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.368407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd5f93-68ea-4ac9-a4ae-d9478a5f1eaa None admin] PATH_INFO: `/v3/services/image` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.369052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd5f93-68ea-4ac9-a4ae-d9478a5f1eaa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:31.370533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd5f93-68ea-4ac9-a4ae-d9478a5f1eaa None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:31.382152 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-10fd5f93-68ea-4ac9-a4ae-d9478a5f1eaa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 31 17:54:31.383486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 531/1048] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Mar 31 17:54:31 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:31.389416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a33580-0cfa-47be-931d-a716cba91028 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:31.422409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483414b-cc2b-4be4-ae07-afbd1bc3bac4 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.423213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483414b-cc2b-4be4-ae07-afbd1bc3bac4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.423493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483414b-cc2b-4be4-ae07-afbd1bc3bac4 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.426627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 532/1049] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:31.431715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437135-b887-4e30-97c1-b3e295047d40 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.432004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437135-b887-4e30-97c1-b3e295047d40 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.432287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437135-b887-4e30-97c1-b3e295047d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.449570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a4437135-b887-4e30-97c1-b3e295047d40 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:31.450789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a4437135-b887-4e30-97c1-b3e295047d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:31.488713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a33580-0cfa-47be-931d-a716cba91028 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:31.515199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 533/1050] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:31.522558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:31.523255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.523537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.523812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.524516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] RBAC: Adding query filter params (name=image) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:31.524822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:31.526177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:31.535564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 518/1051] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:31.536691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437135-b887-4e30-97c1-b3e295047d40 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:31.540179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:31.632965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437135-b887-4e30-97c1-b3e295047d40 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:31.637261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998ca7-92ac-4666-a324-eb53472bdf2f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:31.670885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:31.671649 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.671756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:31.671952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.672200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.672437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.672722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.672906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] RBAC: Adding query filter params (type=image) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:31.673001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.673209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:31.674983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:31.680919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 534/1052] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:31.683801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:31.686283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:31.690699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:54:31.692372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 519/1053] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:54:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:31.698278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:31.784994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd864143-e790-4f00-8135-8a1c6dde63a5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:31.796134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7d0e1-c5cc-4637-b277-f5af06765fad None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:31.818591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:31.819585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.820060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.820334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.821064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:31.822412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:31.829010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:31.829680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.829959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:31.830234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:31.831125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:31.831329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:31.832716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:31.840988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 520/1054] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:54:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:31.846692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:31.883819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 535/1055] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:54:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:31.956336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafdda9-8d84-46ac-8ea4-fb40f35ebb79 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:31.998791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:31.999677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:31.999957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.000230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] PATH_INFO: `/v3/users/1915a2354b4d41738028c22313940cc3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.015574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] RBAC: Authorizing `identity:get_user(user_id=1915a2354b4d41738028c22313940cc3)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:32.017052 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:32.019074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 521/1056] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:31 2022] GET /identity/v3/users/1915a2354b4d41738028c22313940cc3 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:32.024766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:32.131065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f70c0c-1525-4349-aec8-e471518678c2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:32.165303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05865642-ab6f-4b4a-9789-eff9f9ba35f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:32.165978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865642-ab6f-4b4a-9789-eff9f9ba35f6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:32.166257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865642-ab6f-4b4a-9789-eff9f9ba35f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.166529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865642-ab6f-4b4a-9789-eff9f9ba35f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.230169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05865642-ab6f-4b4a-9789-eff9f9ba35f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:32.231642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05865642-ab6f-4b4a-9789-eff9f9ba35f6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:32.325788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 536/1057] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:54:32.331824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:32.428601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9eeb0-3b68-4b8e-969f-5cce83418441 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:32.461888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:32.462765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:32.463048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.463323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.464498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] RBAC: Authorizing `identity:get_project(project_id=5481eab95677436c9fe8d6f0589ef671)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:32.465928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:32.467808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 522/1058] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:54:32 2022] GET /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:32.471606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e9ea-b5c3-46ed-9840-5378d78a37a1 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:32.471899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e9ea-b5c3-46ed-9840-5378d78a37a1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.472179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e9ea-b5c3-46ed-9840-5378d78a37a1 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.474327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:32.475074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 537/1059] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:32.479984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fbf33-f880-4a3b-8e36-39d800c0d3dd None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:32.480274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fbf33-f880-4a3b-8e36-39d800c0d3dd None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.480556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fbf33-f880-4a3b-8e36-39d800c0d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.497661 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-256fbf33-f880-4a3b-8e36-39d800c0d3dd None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:32.498870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-256fbf33-f880-4a3b-8e36-39d800c0d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:32.564194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 538/1060] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:32.571542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb605d5-0198-4198-8afa-a49d8733309a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:32.587881 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fbf33-f880-4a3b-8e36-39d800c0d3dd None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:32.605366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:32.606021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:32.606300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.606572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.607436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=5481eab95677436c9fe8d6f0589ef671, user.id=1915a2354b4d41738028c22313940cc3) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:32.607745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:32.609156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:32.623177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 523/1061] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:32 2022] GET /identity/v3/role_assignments?user.id=1915a2354b4d41738028c22313940cc3&scope.project.id=5481eab95677436c9fe8d6f0589ef671&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:32.690077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fbf33-f880-4a3b-8e36-39d800c0d3dd None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:32.726931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:32.727757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:32.728033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.728301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.739253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:32.746974 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 31 17:54:32.748440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 539/1062] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Mar 31 17:54:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:32.754889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:32.855469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e817f-d91f-4484-856c-9c6c290decf5 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:32.892431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:32.893117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:32.893394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:32.893662 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:32.894416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:32.895287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:32.896729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:32.905462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 524/1063] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Mar 31 17:54:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:32.912216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:33.010019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc36e-6682-4dfa-9acd-38af9e89be1f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:33.043024 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:33.043833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:33.044114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:33.044383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:33.056961 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:33.058431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:33.076128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:33.077497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 540/1064] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:33.083189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:33.179699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ff7a2-8666-40d4-b672-d51627c2b265 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:33.212086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:33.212748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:33.213029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:33.213301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:33.214009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:33.214312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:33.215696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:33.227142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 525/1065] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:33.232645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:33.329477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca163-96ea-4902-a7cd-32019de85176 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:33.361883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:33.362706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:33.362990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:33.363842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:33.371681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:33.373115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:33.386222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:54:33.387590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 541/1066] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:54:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:33.393302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:33.539530 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bf21-8d70-4ee5-891c-7963250d8034 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:33.572358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:33.573023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:33.573302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:33.573575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:33.574399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:33.574734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:33.576150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:33.592835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 526/1067] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:54:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:33.599184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:33.695486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d78c4d-a729-49bd-801b-bfa1ccf26314 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:33.730140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:33.730968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:33.731253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:33.731527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:33.742639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:33.744087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:33.762717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:33.764263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 542/1068] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:33.770193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:33.874558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f35b49-87c1-41f2-913a-1cdf12f17888 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:33.911910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:33.912574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:33.912847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:33.913117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:33.913828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:33.914129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:33.915593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:33.933350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 527/1069] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:33.937959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:34.036553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb8ac-08ca-44ee-82a8-f26f5b9ad172 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:34.072242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:34.073041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:34.073321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:34.073595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:34.080301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:34.081743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:34.097515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:34.099491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 543/1070] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:34.105045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:34.204055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0232b-f794-4c1a-8d60-c5de907f8f50 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:34.237068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24a1ef-7c39-4529-b292-c4d8c32e1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:34.237762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24a1ef-7c39-4529-b292-c4d8c32e1779 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:34.238046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24a1ef-7c39-4529-b292-c4d8c32e1779 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:34.238345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24a1ef-7c39-4529-b292-c4d8c32e1779 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:34.239332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24a1ef-7c39-4529-b292-c4d8c32e1779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:34.239643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24a1ef-7c39-4529-b292-c4d8c32e1779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:34.241132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24a1ef-7c39-4529-b292-c4d8c32e1779 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:34.258938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 528/1071] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:34.260746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:34.299609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90740d-784c-4fbb-9353-b300f39673b1 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:34.299948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90740d-784c-4fbb-9353-b300f39673b1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:34.300178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90740d-784c-4fbb-9353-b300f39673b1 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:34.302657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 529/1072] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:34.308106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8282c-cb40-440c-894a-d8d5856fc077 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:34.308393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8282c-cb40-440c-894a-d8d5856fc077 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:34.308695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8282c-cb40-440c-894a-d8d5856fc077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:34.326222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6de8282c-cb40-440c-894a-d8d5856fc077 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:34.327446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6de8282c-cb40-440c-894a-d8d5856fc077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:34.361833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2c4a9-4b1e-43b6-932d-21dd9675e334 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:34.395656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 530/1073] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:34.399249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:34.399249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:34.399249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:34.399249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/7e46af6e41bb45c08e5a6b9fd596e4f1/roles/2a592ff7598a4baab05dca5d3a8e9209` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:34.401358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=7e46af6e41bb45c08e5a6b9fd596e4f1, role_id=2a592ff7598a4baab05dca5d3a8e9209)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:34.403019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:34.419060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8282c-cb40-440c-894a-d8d5856fc077 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:34.518664 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8282c-cb40-440c-894a-d8d5856fc077 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:34.541121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 544/1074] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:54:34 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/7e46af6e41bb45c08e5a6b9fd596e4f1/roles/2a592ff7598a4baab05dca5d3a8e9209 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:54:34.554342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:34.555506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:34.555506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:34.555789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:34.640157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:34.641718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:34.760462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 531/1075] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 31 17:54:34.766800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:34.863274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7643dc-feff-4638-8cfa-f7ecd29762f7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:34.896307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c3efa-4e44-452f-9034-61439696d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:34.897455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3efa-4e44-452f-9034-61439696d98d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:34.897949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3efa-4e44-452f-9034-61439696d98d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:34.898414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3efa-4e44-452f-9034-61439696d98d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:34.908451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c3efa-4e44-452f-9034-61439696d98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:34.910890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c3efa-4e44-452f-9034-61439696d98d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:34.929028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-e27c3efa-4e44-452f-9034-61439696d98d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:34.930657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 545/1076] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:34.936713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:35.031325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbd7cd-3bae-4639-8545-d80a2acd7019 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:35.065456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:35.066127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.066407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.067324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.068133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:35.068439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:35.069837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:35.072143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b984-36c3-43bc-b71a-1bec1ebc8f11 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.072433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b984-36c3-43bc-b71a-1bec1ebc8f11 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.072708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b984-36c3-43bc-b71a-1bec1ebc8f11 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.074594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 546/1077] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:35.079303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375385ee-d0db-42f1-8ed4-68dbcce8bf21 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.079589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375385ee-d0db-42f1-8ed4-68dbcce8bf21 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.079866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375385ee-d0db-42f1-8ed4-68dbcce8bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.090890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 532/1078] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:35.098049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-375385ee-d0db-42f1-8ed4-68dbcce8bf21 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:35.101634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-375385ee-d0db-42f1-8ed4-68dbcce8bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:35.173573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 547/1079] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:35.197762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:35.300179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce5012-102a-405e-8678-0af1c03bfdb9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:35.334864 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:35.335661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.335940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.336212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.347020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:35.353923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:54:35.355476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 533/1080] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:54:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:35.361105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375385ee-d0db-42f1-8ed4-68dbcce8bf21 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:35.459331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375385ee-d0db-42f1-8ed4-68dbcce8bf21 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:35.491913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:35.492572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.492850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.493121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.493856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:35.494160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:35.495540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:35.503405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 548/1081] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:54:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:35.510098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:35.603365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ac540-af4c-4d36-838f-f001a465f75e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:35.636276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:35.637142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.637424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.637696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] PATH_INFO: `/v3/users/1915a2354b4d41738028c22313940cc3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.638957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] RBAC: Authorizing `identity:get_user(user_id=1915a2354b4d41738028c22313940cc3)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:35.640375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:35.641983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 534/1082] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:35 2022] GET /identity/v3/users/1915a2354b4d41738028c22313940cc3 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:35.647849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:35.744644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906512a9-f2df-436f-9603-a08ab0a3faf2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:35.776474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aeb96-c34a-4958-b4d7-c89ae1968bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:35.777325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aeb96-c34a-4958-b4d7-c89ae1968bcf None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.777601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aeb96-c34a-4958-b4d7-c89ae1968bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.777869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aeb96-c34a-4958-b4d7-c89ae1968bcf None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.779069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aeb96-c34a-4958-b4d7-c89ae1968bcf None admin] RBAC: Authorizing `identity:get_project(project_id=5481eab95677436c9fe8d6f0589ef671)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:35.780483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aeb96-c34a-4958-b4d7-c89ae1968bcf None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:35.782146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 549/1083] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:54:35 2022] GET /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:35.788840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:35.884391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7b5d9-bb74-4063-a331-b4d62623b363 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:35.917557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0b8e5-093a-4112-ad69-5d99a7c9628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:35.918441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0b8e5-093a-4112-ad69-5d99a7c9628a None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:35.918758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0b8e5-093a-4112-ad69-5d99a7c9628a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:35.919037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0b8e5-093a-4112-ad69-5d99a7c9628a None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671/users/1915a2354b4d41738028c22313940cc3/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:35.921058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0b8e5-093a-4112-ad69-5d99a7c9628a None admin] RBAC: Authorizing `identity:create_grant(project_id=5481eab95677436c9fe8d6f0589ef671, user_id=1915a2354b4d41738028c22313940cc3, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:35.922490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0b8e5-093a-4112-ad69-5d99a7c9628a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:36.009139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 535/1084] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:54:35 2022] PUT /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671/users/1915a2354b4d41738028c22313940cc3/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 17:54:36.881814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d98d7c-2e0e-4f2f-b1a9-86c976e19e67 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:36.882367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d98d7c-2e0e-4f2f-b1a9-86c976e19e67 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:36.882367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d98d7c-2e0e-4f2f-b1a9-86c976e19e67 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:36.884291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 550/1085] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:36.889495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba639-e2df-4437-b1af-ceea978059bd None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:36.889913 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba639-e2df-4437-b1af-ceea978059bd None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:36.890168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba639-e2df-4437-b1af-ceea978059bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:36.908018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4daba639-e2df-4437-b1af-ceea978059bd None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:36.909178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4daba639-e2df-4437-b1af-ceea978059bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:36.972466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 536/1086] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:36.997235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d98d7c-2e0e-4f2f-b1a9-86c976e19e67 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:37.102512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d98d7c-2e0e-4f2f-b1a9-86c976e19e67 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:37.137865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:37.138590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:37.139039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:37.139308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:37.150130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:37.157250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 31 17:54:37.158407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 551/1087] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Mar 31 17:54:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:37.164438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba639-e2df-4437-b1af-ceea978059bd None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:37.257714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba639-e2df-4437-b1af-ceea978059bd None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:37.289333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:37.289992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:37.290275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:37.290550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:37.291317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:37.291624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:37.292977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:37.300575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 537/1088] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Mar 31 17:54:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:37.306319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:37.400061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27244c-3537-4772-8ad1-4fcf32254410 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:37.433228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:37.434012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:37.434296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:37.434573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:37.445007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:37.446442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:37.462841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:37.464185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 552/1089] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:37.469592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:37.565534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470b15-2155-455f-af22-3a7d73576011 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:37.597818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:37.598523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:37.598832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:37.599113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:37.599832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:37.600407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:37.601489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:37.613124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 538/1090] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:37.619109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:37.715529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9e8e4-6e0e-4323-a3fc-45304616db10 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:37.747919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:37.748700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:37.748979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:37.749258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:37.757564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:37.759023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:37.772243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 31 17:54:37.773418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 553/1091] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Mar 31 17:54:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:37.779077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:37.874971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd30bc9-7986-42b9-8d35-8c4fb36da569 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:37.906475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:37.907166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:37.907446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:37.907721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:37.908578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:37.908883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:37.910310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:37.930568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 539/1092] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Mar 31 17:54:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:37.936432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.032517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52440b4-6a98-4276-9486-4c8d01a2d5d1 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.067936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566b46f-c826-432d-b183-bdac152ae93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.068590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b46f-c826-432d-b183-bdac152ae93e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.068872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b46f-c826-432d-b183-bdac152ae93e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.069144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566b46f-c826-432d-b183-bdac152ae93e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.135755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566b46f-c826-432d-b183-bdac152ae93e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.137214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566b46f-c826-432d-b183-bdac152ae93e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.230439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 554/1093] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:54:38.236133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.280143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb0ab-e8f0-4c20-81d2-026d61c7565b None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.280420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb0ab-e8f0-4c20-81d2-026d61c7565b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.280694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb0ab-e8f0-4c20-81d2-026d61c7565b None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.282420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 555/1094] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 17:54:38.288067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9e6d-c568-4c05-81d3-d3f2d7c1265a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.288279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9e6d-c568-4c05-81d3-d3f2d7c1265a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.288553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9e6d-c568-4c05-81d3-d3f2d7c1265a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.304612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ac5f9e6d-c568-4c05-81d3-d3f2d7c1265a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:38.305769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ac5f9e6d-c568-4c05-81d3-d3f2d7c1265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:38.331102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80798c-d2f6-4b6a-aa87-29c4f4c02543 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.363656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.364440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.364720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.364994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.368416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 556/1095] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:38.375124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.376578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.391959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f9e6d-c568-4c05-81d3-d3f2d7c1265a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.393882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:54:38.395692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 540/1096] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:38.401198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.487318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f9e6d-c568-4c05-81d3-d3f2d7c1265a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.495582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5b8b8-2766-442a-a969-23f7af1d6350 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.519489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.520842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.521118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.521395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.528636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.529291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.529594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.529865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.530574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:38.530897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:38.530990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.532252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.537976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:54:38.539224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 557/1097] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:38.543225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 541/1098] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:38.545164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.548291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.638769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852bc3-96fa-4011-9918-a8d24cc4308b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.641090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b082aa-d826-4c56-a454-e5116f37f447 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.670885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.671545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.671832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.672109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.672399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.672855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:38.673162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.673262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.673457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.673732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.674539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.680784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.682187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.683413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 558/1099] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:38.688826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.695455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:54:38.696782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 542/1100] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 31 17:54:38.702104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.781962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859a549-6c1d-4025-b7cf-33a4d1eceb3d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.794137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab1a1-2df7-40c6-838d-73710508b603 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.813125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.813988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.814268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.814543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] PATH_INFO: `/v3/users/1915a2354b4d41738028c22313940cc3` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.815755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=1915a2354b4d41738028c22313940cc3)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.817778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.819412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 559/1101] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/users/1915a2354b4d41738028c22313940cc3 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:38.824907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.827536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.828207 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.828490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.828769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.829557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:38.829872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.831342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.843362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 543/1102] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:38.849823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:38.919353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c22bf-13c9-4b6b-897d-b4230fd04ea8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.943880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e671c6-ebff-49df-b475-f6642965db5d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:38.950919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.951674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.951952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.952229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.976706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:38.977362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:38.977644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:38.977921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:38.978779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] RBAC: Adding query filter params (role.id=2a592ff7598a4baab05dca5d3a8e9209, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=7e46af6e41bb45c08e5a6b9fd596e4f1) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:38.979119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:38.980534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:38.986161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 544/1103] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/role_assignments?user.id=7e46af6e41bb45c08e5a6b9fd596e4f1&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=2a592ff7598a4baab05dca5d3a8e9209 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:54:39.019238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:39.021348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:39.252580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 560/1104] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 31 17:54:39.259349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:39.358095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d32d-7af4-46e6-b8ff-28a2274f7768 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:39.391200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930474-fd9e-4602-920a-2dbae4dc3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:39.392096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930474-fd9e-4602-920a-2dbae4dc3c92 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:39.392380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930474-fd9e-4602-920a-2dbae4dc3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:39.392659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930474-fd9e-4602-920a-2dbae4dc3c92 None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:39.393854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930474-fd9e-4602-920a-2dbae4dc3c92 None admin] RBAC: Authorizing `identity:get_project(project_id=5481eab95677436c9fe8d6f0589ef671)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:39.395940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930474-fd9e-4602-920a-2dbae4dc3c92 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:39.397960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 545/1105] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:54:39 2022] GET /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:39.403926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:39.500178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9edb5-9b49-44ee-a866-7d8491411579 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:39.533337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e165f-677b-4072-ade2-299d9ac61ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:39.533983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e165f-677b-4072-ade2-299d9ac61ae6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:39.534264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e165f-677b-4072-ade2-299d9ac61ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:39.534535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e165f-677b-4072-ade2-299d9ac61ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:39.535380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e165f-677b-4072-ade2-299d9ac61ae6 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=5481eab95677436c9fe8d6f0589ef671, user.id=1915a2354b4d41738028c22313940cc3) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:39.535813 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e165f-677b-4072-ade2-299d9ac61ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:39.537215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e165f-677b-4072-ade2-299d9ac61ae6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:39.542941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 561/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:39 2022] GET /identity/v3/role_assignments?user.id=1915a2354b4d41738028c22313940cc3&scope.project.id=5481eab95677436c9fe8d6f0589ef671&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:41.842633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8bc5b-b413-4c24-ba83-de4fd3c342b0 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:41.843191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8bc5b-b413-4c24-ba83-de4fd3c342b0 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:41.843191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8bc5b-b413-4c24-ba83-de4fd3c342b0 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:41.844972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 546/1107] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:41.850559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ac62-57a8-415b-9e17-7d687af0b341 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:41.851013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ac62-57a8-415b-9e17-7d687af0b341 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:41.851184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ac62-57a8-415b-9e17-7d687af0b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:41.868093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f7c4ac62-57a8-415b-9e17-7d687af0b341 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:41.869275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f7c4ac62-57a8-415b-9e17-7d687af0b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:41.932280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 562/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:41.956721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8bc5b-b413-4c24-ba83-de4fd3c342b0 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:42.052869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8bc5b-b413-4c24-ba83-de4fd3c342b0 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:42.086129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6ca86-90a3-4f3f-8aea-88a79586919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:42.086940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6ca86-90a3-4f3f-8aea-88a79586919e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:42.087218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6ca86-90a3-4f3f-8aea-88a79586919e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:42.087488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6ca86-90a3-4f3f-8aea-88a79586919e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:42.088635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6ca86-90a3-4f3f-8aea-88a79586919e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:42.090038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6ca86-90a3-4f3f-8aea-88a79586919e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:42.091653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 547/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:42.097314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4ac62-57a8-415b-9e17-7d687af0b341 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:42.189493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4ac62-57a8-415b-9e17-7d687af0b341 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:42.220996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360741-34eb-4fe5-9cd2-4dc8273360ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:42.221646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360741-34eb-4fe5-9cd2-4dc8273360ba None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:42.221926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360741-34eb-4fe5-9cd2-4dc8273360ba None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:42.222200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360741-34eb-4fe5-9cd2-4dc8273360ba None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:42.222935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360741-34eb-4fe5-9cd2-4dc8273360ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:42.225176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360741-34eb-4fe5-9cd2-4dc8273360ba None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:42.334529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 563/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:54:42 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:44.655259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3eaea-caf9-4001-87ad-f445a7b01353 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:44.655820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3eaea-caf9-4001-87ad-f445a7b01353 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:44.655820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3eaea-caf9-4001-87ad-f445a7b01353 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:44.657565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 548/1111] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:44.662875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad82d08-5c69-4eb2-bcd4-61cc3de24fa5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:44.663251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad82d08-5c69-4eb2-bcd4-61cc3de24fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:44.663441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad82d08-5c69-4eb2-bcd4-61cc3de24fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:44.679877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-6ad82d08-5c69-4eb2-bcd4-61cc3de24fa5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:44.681050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6ad82d08-5c69-4eb2-bcd4-61cc3de24fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:44.743342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 564/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:44.767273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3eaea-caf9-4001-87ad-f445a7b01353 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:44.861595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3eaea-caf9-4001-87ad-f445a7b01353 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:44.893699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:44.894533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:44.894837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:44.895109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] PATH_INFO: `/v3/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:44.897081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] RBAC: Authorizing `identity:get_role(role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:44.898415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:44.899766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 549/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:44 2022] GET /identity/v3/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:44.905423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad82d08-5c69-4eb2-bcd4-61cc3de24fa5 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:44.999155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad82d08-5c69-4eb2-bcd4-61cc3de24fa5 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:45.031404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:45.032257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:45.032542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:45.032819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] PATH_INFO: `/v3/users/b33f23031b88459681358163370ca8d4` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:45.046664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] RBAC: Authorizing `identity:get_user(user_id=b33f23031b88459681358163370ca8d4)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:45.048107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:45.049722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 565/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:44 2022] GET /identity/v3/users/b33f23031b88459681358163370ca8d4 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:45.055399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:45.148087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4f84e-b1f0-41a9-a48e-ce1038d1183e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:45.179438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:45.180013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:45.180291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:45.180560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:45.243082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:45.244513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:45.335677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 550/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:54:45.341458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:45.433300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498f955-0bd0-4b0a-a67b-fc8e57b07af8 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:45.464710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dbecd-ec10-49dd-9e9a-3f1f8c919e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:45.465542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dbecd-ec10-49dd-9e9a-3f1f8c919e71 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:45.465820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dbecd-ec10-49dd-9e9a-3f1f8c919e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:45.466093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dbecd-ec10-49dd-9e9a-3f1f8c919e71 None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:45.467242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dbecd-ec10-49dd-9e9a-3f1f8c919e71 None admin] RBAC: Authorizing `identity:get_project(project_id=5481eab95677436c9fe8d6f0589ef671)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:45.468640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dbecd-ec10-49dd-9e9a-3f1f8c919e71 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:45.470285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 566/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:54:45 2022] GET /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:45.476964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:45.569222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf95bd4-2911-43d4-83e1-f2262633eff2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:45.600578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25fb1d-e97a-4c0f-8e61-ff31cbfb2f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:45.601228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fb1d-e97a-4c0f-8e61-ff31cbfb2f4e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:45.601505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fb1d-e97a-4c0f-8e61-ff31cbfb2f4e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:45.601776 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fb1d-e97a-4c0f-8e61-ff31cbfb2f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:45.602584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fb1d-e97a-4c0f-8e61-ff31cbfb2f4e None admin] RBAC: Adding query filter params (role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=5481eab95677436c9fe8d6f0589ef671, user.id=b33f23031b88459681358163370ca8d4) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:45.602918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fb1d-e97a-4c0f-8e61-ff31cbfb2f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:45.604320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fb1d-e97a-4c0f-8e61-ff31cbfb2f4e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:45.609419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 551/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:45 2022] GET /identity/v3/role_assignments?user.id=b33f23031b88459681358163370ca8d4&scope.project.id=5481eab95677436c9fe8d6f0589ef671&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:47.825425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df49307-5728-4ac0-afbe-04b5f3c91498 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:47.825956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df49307-5728-4ac0-afbe-04b5f3c91498 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:47.825956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df49307-5728-4ac0-afbe-04b5f3c91498 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:47.827740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 567/1118] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:47.832981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4801e3-9248-4151-b6cd-3883de24945f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:47.833384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4801e3-9248-4151-b6cd-3883de24945f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:47.833638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4801e3-9248-4151-b6cd-3883de24945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:47.850644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-da4801e3-9248-4151-b6cd-3883de24945f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:47.851817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-da4801e3-9248-4151-b6cd-3883de24945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:47.915945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 552/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:47.938028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df49307-5728-4ac0-afbe-04b5f3c91498 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:48.033054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df49307-5728-4ac0-afbe-04b5f3c91498 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:48.065764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:48.066621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:48.066905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:48.067174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] PATH_INFO: `/v3/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:48.068872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] RBAC: Authorizing `identity:get_role(role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:48.070211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:48.071562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 568/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:47 2022] GET /identity/v3/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:48.077213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4801e3-9248-4151-b6cd-3883de24945f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:48.169301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4801e3-9248-4151-b6cd-3883de24945f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:48.200994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:48.201856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:48.202139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:48.202416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] PATH_INFO: `/v3/users/b33f23031b88459681358163370ca8d4` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:48.203641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] RBAC: Authorizing `identity:get_user(user_id=b33f23031b88459681358163370ca8d4)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:48.205075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:48.206702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 553/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:48 2022] GET /identity/v3/users/b33f23031b88459681358163370ca8d4 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:48.212880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:48.305592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51f29-c860-4193-9b11-6dea75b3ab15 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:48.337061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d55f60-e085-41df-b3e9-ac369724f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:48.337832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55f60-e085-41df-b3e9-ac369724f5aa None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:48.338108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55f60-e085-41df-b3e9-ac369724f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:48.338377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55f60-e085-41df-b3e9-ac369724f5aa None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:48.339560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d55f60-e085-41df-b3e9-ac369724f5aa None admin] RBAC: Authorizing `identity:get_project(project_id=5481eab95677436c9fe8d6f0589ef671)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:48.340957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d55f60-e085-41df-b3e9-ac369724f5aa None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:48.342575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 569/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:54:48 2022] GET /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:48.349078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:48.441538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ade28-a797-40c5-886e-8f74736b736d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:48.472716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0dce-9243-4977-a6cb-9d785e151367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:48.474187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0dce-9243-4977-a6cb-9d785e151367 None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:48.474467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0dce-9243-4977-a6cb-9d785e151367 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:48.474769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0dce-9243-4977-a6cb-9d785e151367 None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671/users/b33f23031b88459681358163370ca8d4/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:48.476915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e0dce-9243-4977-a6cb-9d785e151367 None admin] RBAC: Authorizing `identity:create_grant(project_id=5481eab95677436c9fe8d6f0589ef671, user_id=b33f23031b88459681358163370ca8d4, role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:48.478307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e0dce-9243-4977-a6cb-9d785e151367 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:48.557941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 554/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:54:48 2022] PUT /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671/users/b33f23031b88459681358163370ca8d4/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:54:50.811421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181656-e56b-4b23-8910-53982ab23086 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:50.812009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181656-e56b-4b23-8910-53982ab23086 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:50.812009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181656-e56b-4b23-8910-53982ab23086 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:50.813693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 570/1124] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:50.819604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af2ac8-95dc-4a9d-9d06-ecf9f002c191 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:50.819984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af2ac8-95dc-4a9d-9d06-ecf9f002c191 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:50.820151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af2ac8-95dc-4a9d-9d06-ecf9f002c191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:50.836920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c6af2ac8-95dc-4a9d-9d06-ecf9f002c191 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:50.838100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c6af2ac8-95dc-4a9d-9d06-ecf9f002c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:50.900515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 555/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:50.923494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181656-e56b-4b23-8910-53982ab23086 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:51.018217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181656-e56b-4b23-8910-53982ab23086 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:51.049062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:51.049888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:51.050161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:51.050426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] PATH_INFO: `/v3/roles/531f0ebdf4bd4cacba8a1bd6e8003f24` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:51.052559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] RBAC: Authorizing `identity:get_role(role_id=531f0ebdf4bd4cacba8a1bd6e8003f24)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:51.053917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:51.055477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 571/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:50 2022] GET /identity/v3/roles/531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:51.060940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af2ac8-95dc-4a9d-9d06-ecf9f002c191 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:51.152417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af2ac8-95dc-4a9d-9d06-ecf9f002c191 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:51.184073 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:51.184934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:51.185213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:51.185486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] PATH_INFO: `/v3/users/b33f23031b88459681358163370ca8d4` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:51.186676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] RBAC: Authorizing `identity:get_user(user_id=b33f23031b88459681358163370ca8d4)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:51.188092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:51.189691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 556/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:54:51 2022] GET /identity/v3/users/b33f23031b88459681358163370ca8d4 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:51.196128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:51.291790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1947d3-cc80-4936-88af-af14676c206c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:51.323076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:51.323708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:51.323989 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:51.324264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:51.386268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:51.387705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:51.478104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 572/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:54:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:54:51.483892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:51.577513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc8ceb-b513-4da3-b787-7700dfcd94f3 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:51.610396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be710bf2-584c-49c4-a7f7-ace1c5f19db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:51.611274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be710bf2-584c-49c4-a7f7-ace1c5f19db9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:51.611558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be710bf2-584c-49c4-a7f7-ace1c5f19db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:51.611831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be710bf2-584c-49c4-a7f7-ace1c5f19db9 None admin] PATH_INFO: `/v3/projects/5481eab95677436c9fe8d6f0589ef671` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:51.613003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be710bf2-584c-49c4-a7f7-ace1c5f19db9 None admin] RBAC: Authorizing `identity:get_project(project_id=5481eab95677436c9fe8d6f0589ef671)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:51.615106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be710bf2-584c-49c4-a7f7-ace1c5f19db9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:51.616859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 557/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:54:51 2022] GET /identity/v3/projects/5481eab95677436c9fe8d6f0589ef671 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:51.623384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:51.715914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adc119-bc98-4bb8-85b8-792540fa7463 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:51.747603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e081f5-8096-484b-8acb-0d727ac073b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:51.748431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e081f5-8096-484b-8acb-0d727ac073b6 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:51.748704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e081f5-8096-484b-8acb-0d727ac073b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:51.748972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e081f5-8096-484b-8acb-0d727ac073b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:51.749776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e081f5-8096-484b-8acb-0d727ac073b6 None admin] RBAC: Adding query filter params (role.id=531f0ebdf4bd4cacba8a1bd6e8003f24, scope.project.id=5481eab95677436c9fe8d6f0589ef671, user.id=b33f23031b88459681358163370ca8d4) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:54:51.750079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e081f5-8096-484b-8acb-0d727ac073b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:51.751495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e081f5-8096-484b-8acb-0d727ac073b6 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:51.757124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 573/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:54:51 2022] GET /identity/v3/role_assignments?user.id=b33f23031b88459681358163370ca8d4&scope.project.id=5481eab95677436c9fe8d6f0589ef671&role.id=531f0ebdf4bd4cacba8a1bd6e8003f24 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:54.042852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6444-d062-4377-8178-193cf268e978 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:54.043385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6444-d062-4377-8178-193cf268e978 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:54.043385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6444-d062-4377-8178-193cf268e978 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:54.045180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 558/1131] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:54.050374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6587b-ca07-44d4-8950-831bdbcc8205 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:54.050816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6587b-ca07-44d4-8950-831bdbcc8205 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:54.050946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6587b-ca07-44d4-8950-831bdbcc8205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:54.068333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-67b6587b-ca07-44d4-8950-831bdbcc8205 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:54.069497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-67b6587b-ca07-44d4-8950-831bdbcc8205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:54.131626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 574/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:54:54.154765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f6444-d062-4377-8178-193cf268e978 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:54.251378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f6444-d062-4377-8178-193cf268e978 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:54.284227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097125f-9c40-4d27-afa7-06bb86fb12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:54.285006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097125f-9c40-4d27-afa7-06bb86fb12e5 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:54.285284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097125f-9c40-4d27-afa7-06bb86fb12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:54.285556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097125f-9c40-4d27-afa7-06bb86fb12e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:54.287263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097125f-9c40-4d27-afa7-06bb86fb12e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:54.288698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097125f-9c40-4d27-afa7-06bb86fb12e5 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:54.290273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 559/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:54.295982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6587b-ca07-44d4-8950-831bdbcc8205 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:54.387737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6587b-ca07-44d4-8950-831bdbcc8205 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:54.419406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d614-cad0-463c-932b-b144bd440e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:54.420043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d614-cad0-463c-932b-b144bd440e47 None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:54.420342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d614-cad0-463c-932b-b144bd440e47 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:54.420615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d614-cad0-463c-932b-b144bd440e47 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:54.421308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d614-cad0-463c-932b-b144bd440e47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:54.422726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d614-cad0-463c-932b-b144bd440e47 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:54.558880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 575/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:54:54 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:56.849572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ff9bc-3288-4007-874d-6e9b60e39902 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:56.850103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ff9bc-3288-4007-874d-6e9b60e39902 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:56.850103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ff9bc-3288-4007-874d-6e9b60e39902 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:56.851901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 560/1135] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:56.857153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbb7f1-aa7c-4bbc-94f6-6aff6cd49315 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:56.857555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbb7f1-aa7c-4bbc-94f6-6aff6cd49315 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:56.857781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbb7f1-aa7c-4bbc-94f6-6aff6cd49315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:56.875615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f2cbb7f1-aa7c-4bbc-94f6-6aff6cd49315 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:56.876785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f2cbb7f1-aa7c-4bbc-94f6-6aff6cd49315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:56.940144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 576/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:56.965174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ff9bc-3288-4007-874d-6e9b60e39902 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:57.060784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ff9bc-3288-4007-874d-6e9b60e39902 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:57.092873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc53b-2c44-4c56-80fc-13593f8c40b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:57.093647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc53b-2c44-4c56-80fc-13593f8c40b6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:57.093923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc53b-2c44-4c56-80fc-13593f8c40b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:57.094193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc53b-2c44-4c56-80fc-13593f8c40b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:57.095358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc53b-2c44-4c56-80fc-13593f8c40b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:57.096762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc53b-2c44-4c56-80fc-13593f8c40b6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:57.098335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 561/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:54:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:54:57.104228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbb7f1-aa7c-4bbc-94f6-6aff6cd49315 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:57.196433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbb7f1-aa7c-4bbc-94f6-6aff6cd49315 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:57.227560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82df6e-98f0-4646-97a6-40b3f758fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:57.228206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82df6e-98f0-4646-97a6-40b3f758fbbc None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:57.228485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82df6e-98f0-4646-97a6-40b3f758fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:57.228756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82df6e-98f0-4646-97a6-40b3f758fbbc None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:57.229467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82df6e-98f0-4646-97a6-40b3f758fbbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:54:57.230894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82df6e-98f0-4646-97a6-40b3f758fbbc None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:54:57.335416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 577/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:54:57 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:54:59.698489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e671a2-fe3a-4ed8-a9d1-940c6f954678 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:59.699081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e671a2-fe3a-4ed8-a9d1-940c6f954678 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:59.699081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e671a2-fe3a-4ed8-a9d1-940c6f954678 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:59.700833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 562/1139] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:54:59.706116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f82c-877e-4b15-b854-e53689ce541f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:59.706516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f82c-877e-4b15-b854-e53689ce541f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:59.706715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f82c-877e-4b15-b854-e53689ce541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:59.724241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a206f82c-877e-4b15-b854-e53689ce541f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:54:59.725581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a206f82c-877e-4b15-b854-e53689ce541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:54:59.788327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 578/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:54:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:54:59.811993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e671a2-fe3a-4ed8-a9d1-940c6f954678 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:54:59.909744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e671a2-fe3a-4ed8-a9d1-940c6f954678 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:54:59.941680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:54:59.942458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:54:59.942768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:54:59.943754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:54:59.953508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:54:59.960540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:54:59.961697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 563/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:54:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:54:59.967808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f82c-877e-4b15-b854-e53689ce541f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:00.060041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f82c-877e-4b15-b854-e53689ce541f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:00.092180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a751e-c046-453e-8012-835ced866c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:00.092831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a751e-c046-453e-8012-835ced866c99 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:00.093107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a751e-c046-453e-8012-835ced866c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:00.093377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a751e-c046-453e-8012-835ced866c99 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:00.094112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a751e-c046-453e-8012-835ced866c99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:00.094416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a751e-c046-453e-8012-835ced866c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:00.095786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a751e-c046-453e-8012-835ced866c99 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:00.103562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 579/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:00.109286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:00.205808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1149a4-b385-431e-90b4-a6b3995e0f42 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:00.236880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:00.237732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:00.238012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:00.238287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] PATH_INFO: `/v3/users/cb952a54671a4172a88d5e826d8a2989` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:00.251678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] RBAC: Authorizing `identity:get_user(user_id=cb952a54671a4172a88d5e826d8a2989)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:00.253111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:00.254777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 564/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:55:00 2022] GET /identity/v3/users/cb952a54671a4172a88d5e826d8a2989 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:00.261117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a751e-c046-453e-8012-835ced866c99 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:00.356485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a751e-c046-453e-8012-835ced866c99 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:00.388063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:00.388694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:00.388973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:00.389244 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:00.451679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:00.453086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:00.544190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 580/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:55:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:55:00.549933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:00.643919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e17c4-264c-4e4b-a73b-28bc69852f15 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:00.675161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae3e66-659d-44f2-a9cb-9cacfba55caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:00.676000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3e66-659d-44f2-a9cb-9cacfba55caf None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:00.676277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3e66-659d-44f2-a9cb-9cacfba55caf None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:00.676547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3e66-659d-44f2-a9cb-9cacfba55caf None admin] PATH_INFO: `/v3/projects/f4624d5ab94f40d18ee22c56f118418e` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:00.678304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae3e66-659d-44f2-a9cb-9cacfba55caf None admin] RBAC: Authorizing `identity:get_project(project_id=f4624d5ab94f40d18ee22c56f118418e)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:00.679746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae3e66-659d-44f2-a9cb-9cacfba55caf None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:00.681385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 565/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:55:00 2022] GET /identity/v3/projects/f4624d5ab94f40d18ee22c56f118418e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:00.687323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:00.779333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efce573-5633-4b66-92f3-f2a05aca4ff4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:00.811054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a2c4b-5f88-43da-a0b9-41e5ed77fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:00.811629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a2c4b-5f88-43da-a0b9-41e5ed77fc65 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:00.811910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a2c4b-5f88-43da-a0b9-41e5ed77fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:00.812183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a2c4b-5f88-43da-a0b9-41e5ed77fc65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:00.812995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a2c4b-5f88-43da-a0b9-41e5ed77fc65 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=f4624d5ab94f40d18ee22c56f118418e, user.id=cb952a54671a4172a88d5e826d8a2989) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:00.813303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a2c4b-5f88-43da-a0b9-41e5ed77fc65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:00.814726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a2c4b-5f88-43da-a0b9-41e5ed77fc65 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:00.820363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 581/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:55:00 2022] GET /identity/v3/role_assignments?user.id=cb952a54671a4172a88d5e826d8a2989&scope.project.id=f4624d5ab94f40d18ee22c56f118418e&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:03.060365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c8e8b-6e19-44d0-afcb-4c538fb9ba50 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:03.060737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c8e8b-6e19-44d0-afcb-4c538fb9ba50 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:03.060921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c8e8b-6e19-44d0-afcb-4c538fb9ba50 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:03.062747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 566/1147] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:03.068054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eeb2d-5dc5-4ca2-87f5-d1130f876e9d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:03.069222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eeb2d-5dc5-4ca2-87f5-d1130f876e9d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:03.069311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eeb2d-5dc5-4ca2-87f5-d1130f876e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:03.085743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-988eeb2d-5dc5-4ca2-87f5-d1130f876e9d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:03.086937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-988eeb2d-5dc5-4ca2-87f5-d1130f876e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:03.149951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 582/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:03.172106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c8e8b-6e19-44d0-afcb-4c538fb9ba50 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:03.269061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c8e8b-6e19-44d0-afcb-4c538fb9ba50 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:03.301309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:03.302084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:03.302364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:03.303304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:03.313178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:55:03.320101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:55:03.321245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 567/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:55:03.327129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eeb2d-5dc5-4ca2-87f5-d1130f876e9d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:03.422987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eeb2d-5dc5-4ca2-87f5-d1130f876e9d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:03.455180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:03.455833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:03.456116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:03.456390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:03.457122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:03.457427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:03.458864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:03.466554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 583/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:55:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:03.472264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:03.566538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb91b-ac23-45b7-946a-6fb0b37b2ad2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:03.596846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0007889-1959-4823-8741-676248e19321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:03.597691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0007889-1959-4823-8741-676248e19321 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:03.597971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0007889-1959-4823-8741-676248e19321 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:03.598240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0007889-1959-4823-8741-676248e19321 None admin] PATH_INFO: `/v3/users/cb952a54671a4172a88d5e826d8a2989` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:03.600017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0007889-1959-4823-8741-676248e19321 None admin] RBAC: Authorizing `identity:get_user(user_id=cb952a54671a4172a88d5e826d8a2989)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:03.601537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0007889-1959-4823-8741-676248e19321 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:03.603229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 568/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:55:03 2022] GET /identity/v3/users/cb952a54671a4172a88d5e826d8a2989 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:03.608766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:03.702036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0ea9-cda7-46ca-b261-27e8b5d1bbbb None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:03.733904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f878-01b0-4fe4-bfb9-2caff1468612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:03.734842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f878-01b0-4fe4-bfb9-2caff1468612 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:03.735122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f878-01b0-4fe4-bfb9-2caff1468612 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:03.735398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f878-01b0-4fe4-bfb9-2caff1468612 None admin] PATH_INFO: `/v3/projects/f4624d5ab94f40d18ee22c56f118418e` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:03.736559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f878-01b0-4fe4-bfb9-2caff1468612 None admin] RBAC: Authorizing `identity:get_project(project_id=f4624d5ab94f40d18ee22c56f118418e)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:03.737962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f878-01b0-4fe4-bfb9-2caff1468612 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:03.739636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 584/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:55:03 2022] GET /identity/v3/projects/f4624d5ab94f40d18ee22c56f118418e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:03.745735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0007889-1959-4823-8741-676248e19321 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:03.842065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0007889-1959-4823-8741-676248e19321 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:03.873677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae0738-a5e8-4b37-b3e0-ff2cac4164bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:03.874817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae0738-a5e8-4b37-b3e0-ff2cac4164bf None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:03.875093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae0738-a5e8-4b37-b3e0-ff2cac4164bf None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:03.875362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae0738-a5e8-4b37-b3e0-ff2cac4164bf None admin] PATH_INFO: `/v3/projects/f4624d5ab94f40d18ee22c56f118418e/users/cb952a54671a4172a88d5e826d8a2989/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:03.877284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae0738-a5e8-4b37-b3e0-ff2cac4164bf None admin] RBAC: Authorizing `identity:create_grant(project_id=f4624d5ab94f40d18ee22c56f118418e, user_id=cb952a54671a4172a88d5e826d8a2989, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:03.878720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae0738-a5e8-4b37-b3e0-ff2cac4164bf None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:04.049806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 569/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:55:03 2022] PUT /identity/v3/projects/f4624d5ab94f40d18ee22c56f118418e/users/cb952a54671a4172a88d5e826d8a2989/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:55:06.324097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25b0d-b8aa-45be-a7a4-2995cb6a7dc4 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:06.324629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25b0d-b8aa-45be-a7a4-2995cb6a7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:06.324629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25b0d-b8aa-45be-a7a4-2995cb6a7dc4 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:06.326327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 585/1154] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:06.331588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8b2b2-59f6-4eeb-8c66-f1e52768d8d2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:06.332017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8b2b2-59f6-4eeb-8c66-f1e52768d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:06.332149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8b2b2-59f6-4eeb-8c66-f1e52768d8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:06.349010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5ee8b2b2-59f6-4eeb-8c66-f1e52768d8d2 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:06.350951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5ee8b2b2-59f6-4eeb-8c66-f1e52768d8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:06.414343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 570/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:06.437824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec25b0d-b8aa-45be-a7a4-2995cb6a7dc4 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:06.534234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec25b0d-b8aa-45be-a7a4-2995cb6a7dc4 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:06.566866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:06.567641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:06.567922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:06.568195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:06.578182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:55:06.585058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:55:06.586198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 586/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:55:06.592128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8b2b2-59f6-4eeb-8c66-f1e52768d8d2 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:06.685577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8b2b2-59f6-4eeb-8c66-f1e52768d8d2 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:06.717306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:06.717957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:06.718235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:06.718506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:06.719268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:06.719571 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:06.720912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:06.729329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 571/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:55:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:06.735022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:06.827610 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ba6c6-3289-416b-b855-2fbad9f58a1b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:06.859859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:06.860662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:06.860944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:06.861219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] PATH_INFO: `/v3/users/cb952a54671a4172a88d5e826d8a2989` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:06.862398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] RBAC: Authorizing `identity:get_user(user_id=cb952a54671a4172a88d5e826d8a2989)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:06.863848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:06.865609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 587/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:55:06 2022] GET /identity/v3/users/cb952a54671a4172a88d5e826d8a2989 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:06.871217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:06.963496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f636f6-43c8-4f0c-8fb8-735b0953d66c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:06.994560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:06.995216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:06.995496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:06.995768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:07.059049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:07.060491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:07.168238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 572/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:55:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:55:07.174063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:07.271321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02011b3-252c-4001-a3bb-784133e7f08b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:07.306232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d338637-780e-42b9-b954-24eba745c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:07.307231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338637-780e-42b9-b954-24eba745c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:07.307738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338637-780e-42b9-b954-24eba745c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:07.308229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338637-780e-42b9-b954-24eba745c6e0 None admin] PATH_INFO: `/v3/projects/f4624d5ab94f40d18ee22c56f118418e` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:07.310061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d338637-780e-42b9-b954-24eba745c6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=f4624d5ab94f40d18ee22c56f118418e)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:07.311560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d338637-780e-42b9-b954-24eba745c6e0 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:07.314147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 588/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:55:07 2022] GET /identity/v3/projects/f4624d5ab94f40d18ee22c56f118418e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:07.321075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:07.417045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cadb2-4eea-470b-8309-f6b701b4a810 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:07.452901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710af89a-a3a0-4e31-a3c0-5ff2d16ff960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:07.453473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710af89a-a3a0-4e31-a3c0-5ff2d16ff960 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:07.453748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710af89a-a3a0-4e31-a3c0-5ff2d16ff960 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:07.454016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710af89a-a3a0-4e31-a3c0-5ff2d16ff960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:07.454857 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710af89a-a3a0-4e31-a3c0-5ff2d16ff960 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=f4624d5ab94f40d18ee22c56f118418e, user.id=cb952a54671a4172a88d5e826d8a2989) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:07.455161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710af89a-a3a0-4e31-a3c0-5ff2d16ff960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:07.456573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710af89a-a3a0-4e31-a3c0-5ff2d16ff960 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:07.462583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 573/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:55:07 2022] GET /identity/v3/role_assignments?user.id=cb952a54671a4172a88d5e826d8a2989&scope.project.id=f4624d5ab94f40d18ee22c56f118418e&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:09.725009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd0c5-6a5d-4163-9bf8-1116c6a42c38 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:09.725513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd0c5-6a5d-4163-9bf8-1116c6a42c38 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:09.725624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd0c5-6a5d-4163-9bf8-1116c6a42c38 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:09.727322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 589/1162] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:09.732391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c973-22e7-402f-b507-3fc3e03a47bc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:09.732811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c973-22e7-402f-b507-3fc3e03a47bc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:09.732954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c973-22e7-402f-b507-3fc3e03a47bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:09.750365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5769c973-22e7-402f-b507-3fc3e03a47bc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:09.751592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5769c973-22e7-402f-b507-3fc3e03a47bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:09.814859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 574/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:09.837840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd0c5-6a5d-4163-9bf8-1116c6a42c38 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:09.934336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd0c5-6a5d-4163-9bf8-1116c6a42c38 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:09.965844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:09.966463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:09.966767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:09.967038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:10.029085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:10.030438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:10.121885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 590/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:55:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:55:10.128102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c973-22e7-402f-b507-3fc3e03a47bc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:10.218746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c973-22e7-402f-b507-3fc3e03a47bc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:10.251148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fe0aa-7646-4d4e-9fc3-f086ed6aa7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:10.251957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fe0aa-7646-4d4e-9fc3-f086ed6aa7b8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:10.252234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fe0aa-7646-4d4e-9fc3-f086ed6aa7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:10.252508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fe0aa-7646-4d4e-9fc3-f086ed6aa7b8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:10.259090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fe0aa-7646-4d4e-9fc3-f086ed6aa7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:10.260527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fe0aa-7646-4d4e-9fc3-f086ed6aa7b8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:10.273641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-702fe0aa-7646-4d4e-9fc3-f086ed6aa7b8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 31 17:55:10.274808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 575/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:55:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:55:10.280744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:10.376245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac3ec-f9b2-405c-9f91-b3cb21cfc608 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:10.417267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e30a0-8b73-4a7c-a7bd-7799d4cf0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:10.417920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e30a0-8b73-4a7c-a7bd-7799d4cf0de3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:10.418200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e30a0-8b73-4a7c-a7bd-7799d4cf0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:10.418470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e30a0-8b73-4a7c-a7bd-7799d4cf0de3 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:10.423052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e30a0-8b73-4a7c-a7bd-7799d4cf0de3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:10.423366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e30a0-8b73-4a7c-a7bd-7799d4cf0de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:10.424713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e30a0-8b73-4a7c-a7bd-7799d4cf0de3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:10.433945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 591/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Mar 31 17:55:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:12.735497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa952-1d85-4a9a-a2a0-2625242ec51f None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:12.736023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa952-1d85-4a9a-a2a0-2625242ec51f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:12.736023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa952-1d85-4a9a-a2a0-2625242ec51f None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:12.737803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 576/1167] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:12.742889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6b69-1301-43d2-beda-f2606f8c975d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:12.743306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6b69-1301-43d2-beda-f2606f8c975d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:12.743472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6b69-1301-43d2-beda-f2606f8c975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:12.760245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7b3a6b69-1301-43d2-beda-f2606f8c975d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:12.761408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7b3a6b69-1301-43d2-beda-f2606f8c975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:12.823879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 592/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:12.847731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aa952-1d85-4a9a-a2a0-2625242ec51f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:12.945291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aa952-1d85-4a9a-a2a0-2625242ec51f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:12.977531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf7e61-d016-44bc-b350-e60158725003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:12.978178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf7e61-d016-44bc-b350-e60158725003 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:12.978485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf7e61-d016-44bc-b350-e60158725003 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:12.978793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf7e61-d016-44bc-b350-e60158725003 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:12.979558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf7e61-d016-44bc-b350-e60158725003 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:12.980917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf7e61-d016-44bc-b350-e60158725003 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:13.109318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 577/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Thu Mar 31 17:55:12 2022] POST /identity/v3/domains => generated 267 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:55:15.451766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bd473-dae1-46ac-b957-9c93bab899d7 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:15.452314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bd473-dae1-46ac-b957-9c93bab899d7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:15.452314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bd473-dae1-46ac-b957-9c93bab899d7 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:15.453993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 593/1170] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:15.459227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c79bf-9ec2-48e0-9572-63d52f32f9df None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:15.459728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c79bf-9ec2-48e0-9572-63d52f32f9df None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:15.459861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c79bf-9ec2-48e0-9572-63d52f32f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:15.476749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5e4c79bf-9ec2-48e0-9572-63d52f32f9df None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:15.478071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5e4c79bf-9ec2-48e0-9572-63d52f32f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:15.540442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 578/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:55:15.563520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bd473-dae1-46ac-b957-9c93bab899d7 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:15.661018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bd473-dae1-46ac-b957-9c93bab899d7 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:15.693626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081de37-f490-4d35-912a-3c621e9ba664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:15.695232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081de37-f490-4d35-912a-3c621e9ba664 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:15.695539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081de37-f490-4d35-912a-3c621e9ba664 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:15.695815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081de37-f490-4d35-912a-3c621e9ba664 None admin] PATH_INFO: `/v3/domains/53b7eb4894e54e1290f9f0f6d14f016c` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:15.705830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081de37-f490-4d35-912a-3c621e9ba664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=53b7eb4894e54e1290f9f0f6d14f016c)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:15.707243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081de37-f490-4d35-912a-3c621e9ba664 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:15.708844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 594/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Thu Mar 31 17:55:15 2022] GET /identity/v3/domains/53b7eb4894e54e1290f9f0f6d14f016c => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:15.714780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c79bf-9ec2-48e0-9572-63d52f32f9df None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:15.808157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c79bf-9ec2-48e0-9572-63d52f32f9df None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:15.840609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07b464-642d-48c6-9f3d-3ed91cfca066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:15.841259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b464-642d-48c6-9f3d-3ed91cfca066 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:15.841542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b464-642d-48c6-9f3d-3ed91cfca066 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:15.841816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b464-642d-48c6-9f3d-3ed91cfca066 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:15.842523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07b464-642d-48c6-9f3d-3ed91cfca066 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:15.843963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07b464-642d-48c6-9f3d-3ed91cfca066 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:15.966366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 579/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:55:15 2022] POST /identity/v3/projects => generated 361 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 17:55:18.274681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a851b-00de-45d9-aef7-906be8a9ada3 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:18.275223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a851b-00de-45d9-aef7-906be8a9ada3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:18.275223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a851b-00de-45d9-aef7-906be8a9ada3 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:18.277021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 595/1174] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:18.282208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53452a71-21c1-411c-8b89-656b68231db8 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:18.282648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53452a71-21c1-411c-8b89-656b68231db8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:18.282795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53452a71-21c1-411c-8b89-656b68231db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:18.423197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-53452a71-21c1-411c-8b89-656b68231db8 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:18.424291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-53452a71-21c1-411c-8b89-656b68231db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:18.487148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 580/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:18.512405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a851b-00de-45d9-aef7-906be8a9ada3 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:18.608707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a851b-00de-45d9-aef7-906be8a9ada3 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:18.640898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06635362-5000-4d5f-908b-adddad2149df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:18.641728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635362-5000-4d5f-908b-adddad2149df None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:18.642004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635362-5000-4d5f-908b-adddad2149df None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:18.642277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635362-5000-4d5f-908b-adddad2149df None admin] PATH_INFO: `/v3/domains/53b7eb4894e54e1290f9f0f6d14f016c` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:18.643461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06635362-5000-4d5f-908b-adddad2149df None admin] RBAC: Authorizing `identity:get_domain(domain_id=53b7eb4894e54e1290f9f0f6d14f016c)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:18.644870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06635362-5000-4d5f-908b-adddad2149df None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:18.646415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 596/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Thu Mar 31 17:55:18 2022] GET /identity/v3/domains/53b7eb4894e54e1290f9f0f6d14f016c => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:18.652133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53452a71-21c1-411c-8b89-656b68231db8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:18.743115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53452a71-21c1-411c-8b89-656b68231db8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:18.774459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f660d-0a4f-44f5-bd36-459ac57a5822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:18.775136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f660d-0a4f-44f5-bd36-459ac57a5822 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:18.775445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f660d-0a4f-44f5-bd36-459ac57a5822 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:18.775694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f660d-0a4f-44f5-bd36-459ac57a5822 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:18.776379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f660d-0a4f-44f5-bd36-459ac57a5822 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:18.777785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f660d-0a4f-44f5-bd36-459ac57a5822 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:18.873529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 581/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:55:18 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:55:21.193205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe0264-696e-4723-b3e3-186ff9345ed9 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:21.193743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe0264-696e-4723-b3e3-186ff9345ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:21.193743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe0264-696e-4723-b3e3-186ff9345ed9 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:21.195687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 597/1178] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:21.200849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b50d6-f6b0-49b5-b44b-2dcf49db4643 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:21.201281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b50d6-f6b0-49b5-b44b-2dcf49db4643 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:21.201380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b50d6-f6b0-49b5-b44b-2dcf49db4643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:21.218303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2e7b50d6-f6b0-49b5-b44b-2dcf49db4643 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:21.219498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2e7b50d6-f6b0-49b5-b44b-2dcf49db4643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:21.282860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 582/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:21.305903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe0264-696e-4723-b3e3-186ff9345ed9 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:21.406851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe0264-696e-4723-b3e3-186ff9345ed9 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:21.432476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:21.433250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:21.433531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:21.433806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:21.443815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:55:21.450797 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:55:21.451943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 598/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:55:21.458177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b50d6-f6b0-49b5-b44b-2dcf49db4643 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:21.550926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b50d6-f6b0-49b5-b44b-2dcf49db4643 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:21.582793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:21.583450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:21.583730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:21.584087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:21.584825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:21.585757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:21.587135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:21.594865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 583/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:55:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:21.600486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:21.695295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6670b03-4dba-4178-a02d-97b6574488db None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:21.726581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:21.727467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:21.727747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:21.728018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] PATH_INFO: `/v3/users/7d3d06ccf1024271a6adc4b64a9e9eb0` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:21.740395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] RBAC: Authorizing `identity:get_user(user_id=7d3d06ccf1024271a6adc4b64a9e9eb0)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:21.742362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:21.744002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 599/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:55:21 2022] GET /identity/v3/users/7d3d06ccf1024271a6adc4b64a9e9eb0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:21.749657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:21.843830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f3327-383a-401b-82e7-be617e2f9934 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:21.874947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:21.875581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:21.875862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:21.876402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:21.939425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:21.940846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:22.033398 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 584/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:55:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:55:22.039956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:22.134406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16516-d0c6-494a-85ee-01f2b2423d42 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:22.166492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340804cd-76f8-4ee8-bd78-dfa9d6ef7fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:22.167358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340804cd-76f8-4ee8-bd78-dfa9d6ef7fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:22.167641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340804cd-76f8-4ee8-bd78-dfa9d6ef7fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:22.167915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340804cd-76f8-4ee8-bd78-dfa9d6ef7fa8 None admin] PATH_INFO: `/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:22.169091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340804cd-76f8-4ee8-bd78-dfa9d6ef7fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=e3f9be4d956c4c7ea9e887315b2a6cf4)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:22.170525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340804cd-76f8-4ee8-bd78-dfa9d6ef7fa8 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:22.172241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 600/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:55:22 2022] GET /identity/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:22.178315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:22.270095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a071871-3955-4f65-a68d-74fd0c49810e None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:22.301753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799949c-ce12-4830-b066-fef4fad59385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:22.302320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799949c-ce12-4830-b066-fef4fad59385 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:22.302600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799949c-ce12-4830-b066-fef4fad59385 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:22.302903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799949c-ce12-4830-b066-fef4fad59385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:22.304329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799949c-ce12-4830-b066-fef4fad59385 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=e3f9be4d956c4c7ea9e887315b2a6cf4, user.id=7d3d06ccf1024271a6adc4b64a9e9eb0) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:22.304640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799949c-ce12-4830-b066-fef4fad59385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:22.306041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799949c-ce12-4830-b066-fef4fad59385 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:22.311272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 585/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:55:22 2022] GET /identity/v3/role_assignments?user.id=7d3d06ccf1024271a6adc4b64a9e9eb0&scope.project.id=e3f9be4d956c4c7ea9e887315b2a6cf4&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:24.555305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df994-e5a7-458a-94a4-096fb20b9c80 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:24.557158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df994-e5a7-458a-94a4-096fb20b9c80 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:24.557440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df994-e5a7-458a-94a4-096fb20b9c80 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:24.559245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 601/1186] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:24.564427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49f62d-ae9d-49c2-8d25-957df2546117 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:24.564812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49f62d-ae9d-49c2-8d25-957df2546117 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:24.565007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49f62d-ae9d-49c2-8d25-957df2546117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:24.581323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-da49f62d-ae9d-49c2-8d25-957df2546117 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:24.582523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-da49f62d-ae9d-49c2-8d25-957df2546117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:24.645632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 586/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:24.668086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670df994-e5a7-458a-94a4-096fb20b9c80 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:24.762894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670df994-e5a7-458a-94a4-096fb20b9c80 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:24.793829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:24.794588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:24.794895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:24.795165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:24.805097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:55:24.811867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:55:24.812942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 602/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:55:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:55:24.818884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49f62d-ae9d-49c2-8d25-957df2546117 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:24.913229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49f62d-ae9d-49c2-8d25-957df2546117 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:24.945277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:24.945928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:24.946206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:24.946477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:24.947243 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:24.947545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:24.948887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:24.956444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 587/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:55:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:24.962286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:25.057358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9026e-77d5-4e1f-a1d2-fcf26875a9a7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:25.089570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:25.090347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:25.090643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:25.090917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] PATH_INFO: `/v3/users/7d3d06ccf1024271a6adc4b64a9e9eb0` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:25.092075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=7d3d06ccf1024271a6adc4b64a9e9eb0)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:25.093480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:25.095104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 603/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:55:24 2022] GET /identity/v3/users/7d3d06ccf1024271a6adc4b64a9e9eb0 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:25.101644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:25.195706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c03ed-2bf0-4d61-8361-383847b0c11a None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:25.228179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799ec9f-1c44-4fa5-b91f-45433d27914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:25.229029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799ec9f-1c44-4fa5-b91f-45433d27914e None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:25.229309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799ec9f-1c44-4fa5-b91f-45433d27914e None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:25.229583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799ec9f-1c44-4fa5-b91f-45433d27914e None admin] PATH_INFO: `/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:25.230886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799ec9f-1c44-4fa5-b91f-45433d27914e None admin] RBAC: Authorizing `identity:get_project(project_id=e3f9be4d956c4c7ea9e887315b2a6cf4)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:25.232308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799ec9f-1c44-4fa5-b91f-45433d27914e None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:25.234026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 588/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:55:25 2022] GET /identity/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:25.240038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:25.333114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c27619-f764-481d-b0eb-d9d0753ca1f9 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:25.364750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3c5d-df79-46ab-8b7c-28581848fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:25.365550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3c5d-df79-46ab-8b7c-28581848fc03 None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:25.365824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3c5d-df79-46ab-8b7c-28581848fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:25.366098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3c5d-df79-46ab-8b7c-28581848fc03 None admin] PATH_INFO: `/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4/users/7d3d06ccf1024271a6adc4b64a9e9eb0/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:25.368596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3c5d-df79-46ab-8b7c-28581848fc03 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3f9be4d956c4c7ea9e887315b2a6cf4, user_id=7d3d06ccf1024271a6adc4b64a9e9eb0, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:25.369999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3c5d-df79-46ab-8b7c-28581848fc03 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:25.515370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 604/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:55:25 2022] PUT /identity/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4/users/7d3d06ccf1024271a6adc4b64a9e9eb0/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:55:27.776678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039953a2-d7e1-45c7-b21a-3a4d907fd02d None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:27.777250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039953a2-d7e1-45c7-b21a-3a4d907fd02d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:27.777391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039953a2-d7e1-45c7-b21a-3a4d907fd02d None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:27.779730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 589/1193] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:55:27.784951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd997-b33d-467a-bd4f-64d14a9b2079 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:27.785376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd997-b33d-467a-bd4f-64d14a9b2079 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:27.785507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd997-b33d-467a-bd4f-64d14a9b2079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:27.802959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-aa6dd997-b33d-467a-bd4f-64d14a9b2079 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:55:27.804232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-aa6dd997-b33d-467a-bd4f-64d14a9b2079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:55:27.866942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 605/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:55:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:55:27.890488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039953a2-d7e1-45c7-b21a-3a4d907fd02d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:27.986308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039953a2-d7e1-45c7-b21a-3a4d907fd02d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:28.018273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:28.019069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:28.019353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:28.019628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:28.029755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:55:28.036394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:55:28.037527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 590/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:55:28.043955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dd997-b33d-467a-bd4f-64d14a9b2079 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:28.137155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dd997-b33d-467a-bd4f-64d14a9b2079 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:28.168358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:28.169008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:28.169288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:28.169558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:28.170288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:28.170588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:28.172101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:28.180254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 606/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:55:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:28.186046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:28.279547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4da2b-1d15-4452-8c15-6baaa7e273bb None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:28.311581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:28.312367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:28.312650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:28.312920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] PATH_INFO: `/v3/users/7d3d06ccf1024271a6adc4b64a9e9eb0` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:28.314090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] RBAC: Authorizing `identity:get_user(user_id=7d3d06ccf1024271a6adc4b64a9e9eb0)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:28.315524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:28.317103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 591/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Mar 31 17:55:28 2022] GET /identity/v3/users/7d3d06ccf1024271a6adc4b64a9e9eb0 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:28.322843 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:28.416139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabaa3f-86b6-4cae-a20e-2ddda52a7924 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:28.447085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:28.447715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:28.447991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:28.448262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:28.510446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:28.511884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:28.603888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 607/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:55:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:55:28.609555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:28.701395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a845-fd0a-4bb6-a0e8-884a3d65150d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:28.732770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedfd69-803f-4c68-b6ba-a720ac2face6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:28.733614 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedfd69-803f-4c68-b6ba-a720ac2face6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:28.733897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedfd69-803f-4c68-b6ba-a720ac2face6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:28.734175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedfd69-803f-4c68-b6ba-a720ac2face6 None admin] PATH_INFO: `/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:28.735373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedfd69-803f-4c68-b6ba-a720ac2face6 None admin] RBAC: Authorizing `identity:get_project(project_id=e3f9be4d956c4c7ea9e887315b2a6cf4)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:28.736817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedfd69-803f-4c68-b6ba-a720ac2face6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:28.738487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 592/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Mar 31 17:55:28 2022] GET /identity/v3/projects/e3f9be4d956c4c7ea9e887315b2a6cf4 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:55:28.744828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:55:28.839952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3f161-2048-49b0-8ad8-8d4dc9e7c5a5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:55:28.873555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab824f-6f6b-489c-b134-d948c197f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:55:28.874155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab824f-6f6b-489c-b134-d948c197f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:55:28.874436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab824f-6f6b-489c-b134-d948c197f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:55:28.874741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab824f-6f6b-489c-b134-d948c197f1e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:55:28.875567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab824f-6f6b-489c-b134-d948c197f1e2 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=e3f9be4d956c4c7ea9e887315b2a6cf4, user.id=7d3d06ccf1024271a6adc4b64a9e9eb0) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:55:28.875877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab824f-6f6b-489c-b134-d948c197f1e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:55:28.877545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab824f-6f6b-489c-b134-d948c197f1e2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:55:28.883175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 608/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:55:28 2022] GET /identity/v3/role_assignments?user.id=7d3d06ccf1024271a6adc4b64a9e9eb0&scope.project.id=e3f9be4d956c4c7ea9e887315b2a6cf4&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:51.114678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a977-ec31-4c87-9e79-319abc3be77f None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:51.115224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a977-ec31-4c87-9e79-319abc3be77f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:51.115224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6a977-ec31-4c87-9e79-319abc3be77f None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:51.117021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 593/1201] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:56:51.122207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163216-2877-4e5d-b08c-5d939f56fe10 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:51.122665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163216-2877-4e5d-b08c-5d939f56fe10 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:51.122824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163216-2877-4e5d-b08c-5d939f56fe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:51.140075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-27163216-2877-4e5d-b08c-5d939f56fe10 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:56:51.141235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-27163216-2877-4e5d-b08c-5d939f56fe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:56:51.203566 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 609/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:56:51.228841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a977-ec31-4c87-9e79-319abc3be77f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:51.325746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6a977-ec31-4c87-9e79-319abc3be77f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:51.357465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:51.358238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:51.358514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:51.358842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:51.369345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:51.370908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:51.387189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:56:51.388349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 594/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:51.394585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163216-2877-4e5d-b08c-5d939f56fe10 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:51.486844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163216-2877-4e5d-b08c-5d939f56fe10 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:51.522149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04179b8-e522-46d2-8665-4bfd9b1b8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:51.522829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04179b8-e522-46d2-8665-4bfd9b1b8428 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:51.523112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04179b8-e522-46d2-8665-4bfd9b1b8428 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:51.523385 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04179b8-e522-46d2-8665-4bfd9b1b8428 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:51.524100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04179b8-e522-46d2-8665-4bfd9b1b8428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:51.524444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04179b8-e522-46d2-8665-4bfd9b1b8428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:51.525788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04179b8-e522-46d2-8665-4bfd9b1b8428 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:51.536495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 610/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:51.542448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:51.637171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bef3d-223e-4c57-ade2-424456e387bd None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:51.668399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb08efb-fb88-49e8-bee2-049a7444db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:51.671609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb08efb-fb88-49e8-bee2-049a7444db1a None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:51.671609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb08efb-fb88-49e8-bee2-049a7444db1a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:51.671609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb08efb-fb88-49e8-bee2-049a7444db1a None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:51.671609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb08efb-fb88-49e8-bee2-049a7444db1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:51.672004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb08efb-fb88-49e8-bee2-049a7444db1a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:51.799336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 595/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Mar 31 17:56:51 2022] POST /identity/v3/users => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:56:54.088630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7c59c-e3db-4cc3-9bf9-59e77a586a37 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:54.089127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7c59c-e3db-4cc3-9bf9-59e77a586a37 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:54.089236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7c59c-e3db-4cc3-9bf9-59e77a586a37 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:54.091016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 611/1206] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:56:54.096105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654f66-2235-43ab-9c2c-420ae40ff272 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:54.096498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654f66-2235-43ab-9c2c-420ae40ff272 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:54.096660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654f66-2235-43ab-9c2c-420ae40ff272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:54.113014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2d654f66-2235-43ab-9c2c-420ae40ff272 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:56:54.118204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2d654f66-2235-43ab-9c2c-420ae40ff272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:56:54.176806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 596/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:56:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:56:54.201015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7c59c-e3db-4cc3-9bf9-59e77a586a37 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:54.310594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7c59c-e3db-4cc3-9bf9-59e77a586a37 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:54.343972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:54.344806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:54.345085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:54.345357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:54.355886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:56:54.362784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:56:54.363945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 612/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:56:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:54.370639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654f66-2235-43ab-9c2c-420ae40ff272 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:54.465931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654f66-2235-43ab-9c2c-420ae40ff272 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:54.499890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:54.500553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:54.500834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:54.501110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:54.501849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:54.502152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:54.503541 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:54.515798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 597/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:56:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:54.521479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:54.618723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06eb3e-ca32-4e35-8ee8-7c156ebc6180 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:54.650685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:54.651464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:54.651746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:54.652018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:54.661753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:54.663207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:54.679476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:56:54.681270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 613/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:54.686959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:54.782664 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b15a6-16a2-4125-8324-d5ace5b8b5b0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:54.814950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:54.815606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:54.815883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:54.816155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:54.816869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:54.817173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:54.818517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:54.830411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 598/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:54.836206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:54.932332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b9d8-a0c9-4517-b2db-4d8ebc1b43e4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:54.964844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:54.965625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:54.965903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:54.966173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:54.973046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:54.974470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:54.988242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 31 17:56:54.989381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 614/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:56:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:54.995674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:55.090936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21cf7a-f02d-4d25-97cd-002b0b89f0cd None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:55.123532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:55.124235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:55.124515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:55.124791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:55.125619 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:55.125925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:55.127360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:55.144607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 599/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Mar 31 17:56:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:55.150506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:55.245619 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7acb6-7938-44c3-bb00-16cac36aa7cd None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:55.277792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:55.278442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:55.278756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:55.279029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:55.341964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:55.343413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:55.435073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 615/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:56:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:56:55.441006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:55.534678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9562f-336d-469d-a6d7-380b704df4d1 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:55.567483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:55.568321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:55.568604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:55.568882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:55.578537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:55.580000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:55.595937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:56:55.597091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 600/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:55.603349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:55.697311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78cb63-1d27-4503-b690-be03211b7d50 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:55.729185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:55.729834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:55.730112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:55.730382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:55.731124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:55.731425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:55.735620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:55.744263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 616/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:55.749883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:55.843969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d15966-9002-4588-8e7e-1df8c2f013e6 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:55.875732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:55.876511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:55.876790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:55.877111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:55.884318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:55.885740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:55.898223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:56:55.899510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 601/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:56:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:55.905274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:56.001241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23edd4-5538-4be7-8886-43bf7ae27a19 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:56.033781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041dc7-b659-4509-a655-e5265e87f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:56.034432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041dc7-b659-4509-a655-e5265e87f828 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:56.034741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041dc7-b659-4509-a655-e5265e87f828 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:56.035011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041dc7-b659-4509-a655-e5265e87f828 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:56.035779 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041dc7-b659-4509-a655-e5265e87f828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:56.036080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041dc7-b659-4509-a655-e5265e87f828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:56.037506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041dc7-b659-4509-a655-e5265e87f828 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:56.049847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 617/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:56.056836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:56.154637 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cbadb-3894-45a0-b76f-49c73aa0fd84 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:56.187566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d1f11-74c4-454f-805d-ee0629f1ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:56.188223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1f11-74c4-454f-805d-ee0629f1ef20 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:56.188506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1f11-74c4-454f-805d-ee0629f1ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:56.188801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1f11-74c4-454f-805d-ee0629f1ef20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:56.189627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d1f11-74c4-454f-805d-ee0629f1ef20 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=511e982844c347c8bd49f51aaf29be71) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:56.189938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d1f11-74c4-454f-805d-ee0629f1ef20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:56.191378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d1f11-74c4-454f-805d-ee0629f1ef20 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:56.196885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 602/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:56:56 2022] GET /identity/v3/role_assignments?user.id=511e982844c347c8bd49f51aaf29be71&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:56:58.447742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9f2b9-6727-4852-9ee3-be122fd58042 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:58.448258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9f2b9-6727-4852-9ee3-be122fd58042 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:58.448258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9f2b9-6727-4852-9ee3-be122fd58042 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:58.449933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 618/1220] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:56:58.455132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86c8c-ecd6-41ce-b241-122042940ec5 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:58.455526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86c8c-ecd6-41ce-b241-122042940ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:58.455682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86c8c-ecd6-41ce-b241-122042940ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:58.472424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-92c86c8c-ecd6-41ce-b241-122042940ec5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:56:58.473581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-92c86c8c-ecd6-41ce-b241-122042940ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:56:58.536606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 603/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:56:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:56:58.560553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9f2b9-6727-4852-9ee3-be122fd58042 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:58.657301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9f2b9-6727-4852-9ee3-be122fd58042 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:58.689094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:58.689872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:58.690146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:58.690434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:58.703695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:56:58.706788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:56:58.707934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 619/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:58.714334 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86c8c-ecd6-41ce-b241-122042940ec5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:58.809627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86c8c-ecd6-41ce-b241-122042940ec5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:58.842032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:58.842714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:58.842994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:58.843265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:58.844031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:58.844336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:58.845673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:58.854214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 604/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:58.860036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:58.954862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee94cb-1f49-402d-93dc-e84e1ab473bc None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:58.987677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:58.988459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:58.988741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:58.989015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:58.999484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:59.001860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:59.018875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:56:59.020061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 620/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:59.026702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:59.121609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1560f78-0e32-4ee4-bf62-96a100badab8 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:59.153838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:59.154494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:59.154806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:59.155084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:59.155798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:59.156104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:59.157455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:59.169167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 605/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:59.174999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:59.271858 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526904-396e-4101-bf53-ca4d9465dd57 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:59.303955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:59.304918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:59.305228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:59.305508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:59.312728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:59.314179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:59.328029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 31 17:56:59.329191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 621/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:56:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:59.335113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:59.428060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1228ae-a2b4-40f3-8b22-ca646ca08ba0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:59.460465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:59.482355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:59.482355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:59.482355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:59.482355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:59.482355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:59.482355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:59.482827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 606/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Mar 31 17:56:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:59.486739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:59.593912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe881d7-1cda-46fa-b6c5-31c515ea1002 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:59.626364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:59.627171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:59.627454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:59.627737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:59.638297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:59.639758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:59.655573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:56:59.656807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 622/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:59.662511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:59.760673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0194015-4d87-452f-920c-d38141a8f14d None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:59.792515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:59.793164 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:59.793446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:59.793718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:59.794421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:56:59.794759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:59.796103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:59.807561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 607/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:56:59.812923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:56:59.918797 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcad81-0e6e-40a2-8f07-517f86ab9c0c None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:56:59.951919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:56:59.952697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:56:59.952977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:56:59.953251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:56:59.959750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:56:59.961729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:56:59.975416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:56:59.977182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 623/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:56:59.983125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:00.078849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26586be-d10f-47f7-bd8e-fc5d119480c9 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:00.111176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec494c0-74fd-447e-9d2f-e7fa1b202a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:00.111863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec494c0-74fd-447e-9d2f-e7fa1b202a5f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:00.112147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec494c0-74fd-447e-9d2f-e7fa1b202a5f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:00.112446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec494c0-74fd-447e-9d2f-e7fa1b202a5f None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:00.113213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec494c0-74fd-447e-9d2f-e7fa1b202a5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:00.113519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec494c0-74fd-447e-9d2f-e7fa1b202a5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:00.114942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec494c0-74fd-447e-9d2f-e7fa1b202a5f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:00.126306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 608/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:00.132492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:00.230436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da11d9-81ed-4d3a-9c47-cc54d1eaf437 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:00.266009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dd384-0f21-4e74-99ee-2515cbdcbfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:00.266967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dd384-0f21-4e74-99ee-2515cbdcbfec None admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:00.267240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dd384-0f21-4e74-99ee-2515cbdcbfec None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:00.267511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dd384-0f21-4e74-99ee-2515cbdcbfec None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/511e982844c347c8bd49f51aaf29be71/roles/4428e6eb6e55408d98a28a91a43b4935` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:00.281805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dd384-0f21-4e74-99ee-2515cbdcbfec None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=511e982844c347c8bd49f51aaf29be71, role_id=4428e6eb6e55408d98a28a91a43b4935)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:00.283267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dd384-0f21-4e74-99ee-2515cbdcbfec None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:00.381614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 624/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:57:00 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/511e982844c347c8bd49f51aaf29be71/roles/4428e6eb6e55408d98a28a91a43b4935 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:57:02.667393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38f0d-bfcc-45a2-9539-bf9b1ac76cbe None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:02.667921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38f0d-bfcc-45a2-9539-bf9b1ac76cbe None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:02.667921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38f0d-bfcc-45a2-9539-bf9b1ac76cbe None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:02.669711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 609/1233] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:02.674904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705997fd-fd5d-4340-8dba-53935ee47502 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:02.675306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705997fd-fd5d-4340-8dba-53935ee47502 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:02.675484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705997fd-fd5d-4340-8dba-53935ee47502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:02.692335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-705997fd-fd5d-4340-8dba-53935ee47502 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:02.701745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-705997fd-fd5d-4340-8dba-53935ee47502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:02.758542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 625/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:57:02.782225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38f0d-bfcc-45a2-9539-bf9b1ac76cbe None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:02.880186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38f0d-bfcc-45a2-9539-bf9b1ac76cbe None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:02.912717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:02.913503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:02.913971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:02.914254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:02.923983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:57:02.931523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 31 17:57:02.932683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 610/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Mar 31 17:57:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:02.938690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705997fd-fd5d-4340-8dba-53935ee47502 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:03.033483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705997fd-fd5d-4340-8dba-53935ee47502 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:03.066965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:03.067628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:03.067907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:03.068180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:03.068919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] RBAC: Adding query filter params (name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:03.069223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:03.071131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:03.078925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 626/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Mar 31 17:57:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:03.084573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:03.181035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45839bf9-b493-4445-b809-00d30fdf11bf None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:03.213561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:03.221710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:03.221710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:03.221710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:03.225510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:03.227505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:03.244151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:03.245350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 611/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:03.251256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:03.347061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95880d5-b802-4620-9303-1cab580e9f0d None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:03.379380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:03.380040 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:03.380344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:03.380624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:03.381345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:03.381653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:03.383431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:03.395454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 627/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:03.401778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:03.495909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59903-cbd2-4045-8eec-168c93a477a5 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:03.528127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:03.528933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:03.529212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:03.529480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:03.537383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:03.539516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:03.552421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 31 17:57:03.553553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 612/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:03.559319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:03.656565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0123c-4e3a-40bb-8cf1-39471b44cbb4 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:03.688490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:03.689195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:03.689461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:03.689733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:03.690551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:03.690877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:03.692278 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:03.708703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 628/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Mar 31 17:57:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:03.715036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:03.810301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf9604-d152-4de9-aa17-8574758f47d5 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:03.842742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:03.843378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:03.843660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:03.843935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:03.908540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:03.910122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:04.003118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 613/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:57:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:57:04.009775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:04.106415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74418f0-db4e-4c94-b905-bd72a831ca77 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:04.139980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:04.140767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:04.141092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:04.141320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:04.151181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:04.152604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:04.168776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:04.169920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 629/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:04.175900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:04.271734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f94f0-ca47-4770-b96f-bd41366e4d7f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:04.304910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:04.305560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:04.305836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:04.306209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:04.306880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:04.307193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:04.308526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:04.319413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 614/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:04.325700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:04.419458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ef37a-99d9-4123-ae30-1444574aada7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:04.452459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:04.453235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:04.453515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:04.453787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:04.460228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:04.461735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:04.474190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:57:04.475353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 630/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:57:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:04.481640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:04.581519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426a9b6-b2f9-49e4-9c90-4e52f4bd5d05 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:04.613415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5563c4-f10a-4bfa-8496-7a751d75e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:04.614066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5563c4-f10a-4bfa-8496-7a751d75e327 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:04.614357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5563c4-f10a-4bfa-8496-7a751d75e327 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:04.614630 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5563c4-f10a-4bfa-8496-7a751d75e327 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:04.615468 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5563c4-f10a-4bfa-8496-7a751d75e327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:04.615770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5563c4-f10a-4bfa-8496-7a751d75e327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:04.617779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5563c4-f10a-4bfa-8496-7a751d75e327 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:04.629310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 615/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:04.635718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:04.731386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650181-f97e-4a4d-a124-56d9bd643d2f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:04.764119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb22247-31dc-438e-a443-d9ef29f5adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:04.764766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22247-31dc-438e-a443-d9ef29f5adb7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:04.765046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22247-31dc-438e-a443-d9ef29f5adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:04.765319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22247-31dc-438e-a443-d9ef29f5adb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:04.766137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb22247-31dc-438e-a443-d9ef29f5adb7 None admin] RBAC: Adding query filter params (role.id=4428e6eb6e55408d98a28a91a43b4935, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=511e982844c347c8bd49f51aaf29be71) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:04.766443 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb22247-31dc-438e-a443-d9ef29f5adb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:04.767879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb22247-31dc-438e-a443-d9ef29f5adb7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:04.773563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 631/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:57:04 2022] GET /identity/v3/role_assignments?user.id=511e982844c347c8bd49f51aaf29be71&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=4428e6eb6e55408d98a28a91a43b4935 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:07.086030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d5ba2-7686-48db-b079-cb7b1fc608ec None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:07.086461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d5ba2-7686-48db-b079-cb7b1fc608ec None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:07.086588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d5ba2-7686-48db-b079-cb7b1fc608ec None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:07.088498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 616/1247] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:07.093513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44456-1e0f-4673-8172-ae6ba9006f95 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:07.093884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44456-1e0f-4673-8172-ae6ba9006f95 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:07.094061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44456-1e0f-4673-8172-ae6ba9006f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:07.110668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c0f44456-1e0f-4673-8172-ae6ba9006f95 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:07.111848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c0f44456-1e0f-4673-8172-ae6ba9006f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:07.175824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 632/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:57:07.200795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d5ba2-7686-48db-b079-cb7b1fc608ec None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:07.307004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d5ba2-7686-48db-b079-cb7b1fc608ec None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:07.340214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:07.340522 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:07.340798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:07.341067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:07.350454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:57:07.357481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:57:07.358667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 617/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:07.364849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44456-1e0f-4673-8172-ae6ba9006f95 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:07.458783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44456-1e0f-4673-8172-ae6ba9006f95 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:07.490884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:07.492138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:07.492384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:07.492659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:07.493401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:07.493706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:07.495103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:07.503003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 633/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:07.509299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:07.604900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5c3e-5ee7-475b-8cec-f47c14d49212 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:07.636880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:07.637704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:07.637986 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:07.638256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:07.649300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:07.650755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:07.666797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:07.667955 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 618/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:07.673687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:07.768966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c61b3-8996-4260-b2e7-bec3c0e43e32 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:07.800890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:07.801548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:07.801892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:07.802162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:07.803007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:07.803309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:07.805171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:07.816583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 634/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:07.822310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:07.918291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40d488-73ee-4e7e-a732-99ab5212de28 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:07.951623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:07.952413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:07.952778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:07.953061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:07.960433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:07.961985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:07.975341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 31 17:57:07.976543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 619/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:07.982433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:08.079747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fd2f0-e357-4718-8604-dcf4d1d8bb9f None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:08.112603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:08.113264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:08.113541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:08.113924 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:08.114778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:08.115086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:08.117298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:08.134812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 635/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Mar 31 17:57:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:08.140423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:08.236276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b358ec-56ad-4840-952b-562d5489236f None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:08.269192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:08.269857 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:08.270144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:08.270420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:08.335972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:08.337422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:08.431281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 620/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:57:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:57:08.437157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:08.531583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df956329-cb4e-461d-8c12-b8025623e239 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:08.563095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:08.563874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:08.564146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:08.564416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:08.574477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:08.575917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:08.592416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:08.593546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 636/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:08.599309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:08.693538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f774661-6df4-4a11-8db4-e9c0450e4969 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:08.725338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:08.728366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:08.728366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:08.728366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:08.728366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:08.728366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:08.728901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:08.739423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 621/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:08.745683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:08.841609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb23774-de0a-4c3a-b259-b74ef43b25d3 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:08.873730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:08.874492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:08.874794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:08.875061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:08.881402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:08.883772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:08.896244 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:57:08.897515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 637/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:08.903410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:09.000018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7c21e-76a2-4d98-9b8f-58fe170d9fbb None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:09.031629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144d25-a9a2-4aa3-a942-36d0041a9910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:09.032277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144d25-a9a2-4aa3-a942-36d0041a9910 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:09.032555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144d25-a9a2-4aa3-a942-36d0041a9910 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:09.032826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144d25-a9a2-4aa3-a942-36d0041a9910 None admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:09.033603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144d25-a9a2-4aa3-a942-36d0041a9910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:09.033906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144d25-a9a2-4aa3-a942-36d0041a9910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:09.035337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144d25-a9a2-4aa3-a942-36d0041a9910 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:09.047321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 622/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:09.053424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:09.152876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6f9d-948e-42b8-8bbc-5046d33936ae None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:09.184142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ec645-6182-475e-8668-3c299d086235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:09.184783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec645-6182-475e-8668-3c299d086235 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:09.185062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec645-6182-475e-8668-3c299d086235 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:09.185383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec645-6182-475e-8668-3c299d086235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:09.186202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec645-6182-475e-8668-3c299d086235 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=511e982844c347c8bd49f51aaf29be71) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:09.186508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec645-6182-475e-8668-3c299d086235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:09.187952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec645-6182-475e-8668-3c299d086235 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:09.193093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 638/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:57:09 2022] GET /identity/v3/role_assignments?user.id=511e982844c347c8bd49f51aaf29be71&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=641f3a975368436eac3de51f3605c569 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:11.477158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc7775-797b-4258-b0ad-b2abd67d5bb9 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:11.477714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc7775-797b-4258-b0ad-b2abd67d5bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:11.477714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc7775-797b-4258-b0ad-b2abd67d5bb9 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:11.479492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 623/1261] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:11.484645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc1830-9d6e-47d1-b357-8479103b6e8c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:11.485042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc1830-9d6e-47d1-b357-8479103b6e8c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:11.485199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc1830-9d6e-47d1-b357-8479103b6e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:11.502264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-19cc1830-9d6e-47d1-b357-8479103b6e8c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:11.504329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-19cc1830-9d6e-47d1-b357-8479103b6e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:11.565428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 639/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:57:11.588323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc7775-797b-4258-b0ad-b2abd67d5bb9 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:11.686077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc7775-797b-4258-b0ad-b2abd67d5bb9 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:11.720385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:11.721169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:11.721446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:11.721717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:11.732218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:57:11.739091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:57:11.740299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 624/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:11.746462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc1830-9d6e-47d1-b357-8479103b6e8c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:11.840379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc1830-9d6e-47d1-b357-8479103b6e8c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:11.872421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:11.873069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:11.873345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:11.873616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:11.874349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:11.874678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:11.876017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:11.884244 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 640/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:11.890162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:11.986371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b00f-29db-4209-aef6-6e9e12c779bc None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:12.017493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:12.018271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:12.018546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:12.018874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:12.029509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:12.030969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:12.046671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:12.047891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 625/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:12.053863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:12.148785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822875d-c39f-467a-98cf-6695592d0d64 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:12.179981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:12.180635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:12.180914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:12.181189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:12.181905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:12.182209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:12.183594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:12.195174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 641/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:12.200771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:12.295110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768cc17-70a8-4dd9-ac9a-f0c70e83bca2 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:12.326438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:12.327308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:12.327586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:12.327858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:12.336394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:12.337803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:12.350911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 31 17:57:12.352037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 626/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:12.357862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:12.452689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2567-22ab-4a27-8c9a-573a7a4bf9a2 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:12.485089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:12.485754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:12.486031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:12.486299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:12.487153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:12.487456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:12.488859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:12.505492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 642/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Mar 31 17:57:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:12.511943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:12.606189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904b15-27d2-43a3-a1e2-b1935a22e67c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:12.638786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:12.639567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:12.639848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:12.640116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:12.650691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:12.652141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:12.669119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:12.670338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 627/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:12.676068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:12.773124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e5b73-2bb7-4b3c-a395-4c8da67f1057 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:12.806333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:12.807007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:12.807287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:12.807561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:12.808274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:12.808576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:12.809918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:12.820815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 643/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:12.826451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:12.922440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9337c-a5a6-496b-ae52-6fc75342b5e7 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:12.953882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:12.954688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:12.954971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:12.955240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:12.961952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:12.963463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:12.977915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:57:12.979201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 628/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:12.986692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:13.088027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300accb0-34b9-4826-b30b-26dbbf0a2a45 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:13.119785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe319f-2749-40f1-920d-dc604269cb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:13.120430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe319f-2749-40f1-920d-dc604269cb3c None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:13.120704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe319f-2749-40f1-920d-dc604269cb3c None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:13.120973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe319f-2749-40f1-920d-dc604269cb3c None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:13.121736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe319f-2749-40f1-920d-dc604269cb3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:13.122035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe319f-2749-40f1-920d-dc604269cb3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:13.123457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe319f-2749-40f1-920d-dc604269cb3c None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:13.135973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 644/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:13.142111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:13.234866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16057d-182d-4110-b976-bfe522e35339 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:13.267737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79341465-693c-4c25-9c9e-39a81a4d3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:13.268603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341465-693c-4c25-9c9e-39a81a4d3e2f None admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:13.268879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341465-693c-4c25-9c9e-39a81a4d3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:13.269148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341465-693c-4c25-9c9e-39a81a4d3e2f None admin] PATH_INFO: `/v3/projects/7d88303898234f6ea96c154537ff7558/users/511e982844c347c8bd49f51aaf29be71/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:13.271127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79341465-693c-4c25-9c9e-39a81a4d3e2f None admin] RBAC: Authorizing `identity:create_grant(project_id=7d88303898234f6ea96c154537ff7558, user_id=511e982844c347c8bd49f51aaf29be71, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:13.272565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79341465-693c-4c25-9c9e-39a81a4d3e2f None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:13.374594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 629/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Mar 31 17:57:13 2022] PUT /identity/v3/projects/7d88303898234f6ea96c154537ff7558/users/511e982844c347c8bd49f51aaf29be71/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 17:57:15.625805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544e451-e99e-4f08-bc21-e4576b49d1c4 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:15.626344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544e451-e99e-4f08-bc21-e4576b49d1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:15.626344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544e451-e99e-4f08-bc21-e4576b49d1c4 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:15.628618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 645/1274] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:15.634811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff11c6-a5e5-45c8-b6d8-5b4cbe76f971 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:15.639200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff11c6-a5e5-45c8-b6d8-5b4cbe76f971 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:15.639200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff11c6-a5e5-45c8-b6d8-5b4cbe76f971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:15.652223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-dcff11c6-a5e5-45c8-b6d8-5b4cbe76f971 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:15.653399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dcff11c6-a5e5-45c8-b6d8-5b4cbe76f971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:15.716482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 630/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:57:15.740681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544e451-e99e-4f08-bc21-e4576b49d1c4 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:15.839190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544e451-e99e-4f08-bc21-e4576b49d1c4 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:15.870460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:15.871281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:15.871558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:15.871832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:15.882370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 31 17:57:15.889109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 31 17:57:15.890261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 646/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Mar 31 17:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:15.896157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff11c6-a5e5-45c8-b6d8-5b4cbe76f971 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:15.987943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff11c6-a5e5-45c8-b6d8-5b4cbe76f971 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:16.020790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:16.021504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:16.023006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:16.023287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:16.024022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:16.024323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:16.025762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:16.033444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 631/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Mar 31 17:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:16.039700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:16.137713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f52d6-3ce0-40e4-8751-322cf19742a5 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:16.170870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:16.171660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:16.171943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:16.172218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:16.182197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:16.183660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:16.199330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:16.200487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 647/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:16.206317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:16.302602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708b44f-dda1-4db7-97e9-465fa0a983a0 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:16.334941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:16.335591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:16.340088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:16.340088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:16.340088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:16.340088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:16.340088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:16.350302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 632/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:16.355888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:16.451395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2448ee5-8387-4d7c-af0d-857a10d89224 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:16.483850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:16.484642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:16.484921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:16.485195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:16.492635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:16.494062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:16.508171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 31 17:57:16.509304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 648/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:16.515065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:16.609061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9100783-7acc-4406-9cf1-3b526c595b99 None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:16.641260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:16.641915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:16.642192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:16.642461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:16.643305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:16.643610 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:16.645009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:16.662249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 633/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Mar 31 17:57:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:16.667999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:16.763910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f518c-f6c7-4961-a0ec-9978357c57b3 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:16.795936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:16.796572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:16.796849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:16.797119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:16.860093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:16.861505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:16.956211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 649/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Mar 31 17:57:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 31 17:57:16.962177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:17.060719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db3da3-0886-4a28-98c2-f7f2605bd3dc None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:17.093642 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:17.094447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:17.094757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:17.095032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:17.104896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:17.106397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:17.123267 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 31 17:57:17.124448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 634/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 17:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:17.130125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:17.228164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35195fb8-ba61-4da5-896d-df5516c01c3b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:17.261738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:17.265870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:17.265870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:17.265870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:17.265870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:17.265870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:17.265870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:17.276087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 650/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Mar 31 17:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:17.282083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:17.381186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e982-b1af-415a-844b-f1d30aeed2ff None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:17.414445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:17.415254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:17.415537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:17.415807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:17.422185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:17.423641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:17.436766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING keystone.server.flask.application [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 31 17:57:17.437917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 635/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Mar 31 17:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:17.443953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:17.538521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b19a9-d21f-4a98-a4e4-ef57e1b0ae9a None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:17.570584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba322b-d4d5-4f37-9034-1ebec1a06de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:17.571258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba322b-d4d5-4f37-9034-1ebec1a06de1 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:17.571541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba322b-d4d5-4f37-9034-1ebec1a06de1 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:17.571818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba322b-d4d5-4f37-9034-1ebec1a06de1 None admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:17.572590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba322b-d4d5-4f37-9034-1ebec1a06de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:17.572903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba322b-d4d5-4f37-9034-1ebec1a06de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:17.574311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba322b-d4d5-4f37-9034-1ebec1a06de1 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:17.587324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 651/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Mar 31 17:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:17.593358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:17.690660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eb028-29b3-4d58-b1c9-bb967722cd6c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:17.724268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0571e-a891-4bd3-a5e8-37f12ec97e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:17.725660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0571e-a891-4bd3-a5e8-37f12ec97e80 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:17.725942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0571e-a891-4bd3-a5e8-37f12ec97e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:17.726217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0571e-a891-4bd3-a5e8-37f12ec97e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:17.727073 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0571e-a891-4bd3-a5e8-37f12ec97e80 None admin] RBAC: Adding query filter params (role.id=641f3a975368436eac3de51f3605c569, scope.project.id=7d88303898234f6ea96c154537ff7558, user.id=511e982844c347c8bd49f51aaf29be71) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:17.727385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0571e-a891-4bd3-a5e8-37f12ec97e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:17.728941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0571e-a891-4bd3-a5e8-37f12ec97e80 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:17.734701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 636/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Mar 31 17:57:17 2022] GET /identity/v3/role_assignments?user.id=511e982844c347c8bd49f51aaf29be71&scope.project.id=7d88303898234f6ea96c154537ff7558&role.id=641f3a975368436eac3de51f3605c569 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:20.025422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245bfb9-841c-4927-a861-87b631141f0a None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:20.025991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245bfb9-841c-4927-a861-87b631141f0a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:20.025991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245bfb9-841c-4927-a861-87b631141f0a None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:20.027782 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 652/1288] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:20.033079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f55a4-cc0d-4877-93f1-1c30137ccff2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:20.033509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f55a4-cc0d-4877-93f1-1c30137ccff2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:20.033636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f55a4-cc0d-4877-93f1-1c30137ccff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:20.050865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-dd1f55a4-cc0d-4877-93f1-1c30137ccff2 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:20.052152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dd1f55a4-cc0d-4877-93f1-1c30137ccff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:20.115871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 637/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:57:20.137689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245bfb9-841c-4927-a861-87b631141f0a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:20.236687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245bfb9-841c-4927-a861-87b631141f0a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:20.274262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:20.275084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:20.275362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:20.275679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:20.276279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:20.277636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:20.288463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 31 17:57:20.289595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 653/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:57:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:20.296005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f55a4-cc0d-4877-93f1-1c30137ccff2 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:20.388963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f55a4-cc0d-4877-93f1-1c30137ccff2 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:20.421218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe0bb2-8ced-4a26-99c9-c6bf7a16ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:20.421875 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe0bb2-8ced-4a26-99c9-c6bf7a16ed3c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:20.422156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe0bb2-8ced-4a26-99c9-c6bf7a16ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:20.422431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe0bb2-8ced-4a26-99c9-c6bf7a16ed3c None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:20.423158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe0bb2-8ced-4a26-99c9-c6bf7a16ed3c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:20.423464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe0bb2-8ced-4a26-99c9-c6bf7a16ed3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:20.424814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe0bb2-8ced-4a26-99c9-c6bf7a16ed3c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:20.429424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 638/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Mar 31 17:57:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:20.435328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:20.531630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8fad5-0549-4ef0-a858-adbcc6c7239b None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:20.563857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6f0b4-3607-45d0-a80f-bb343ffbba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:20.564517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f0b4-3607-45d0-a80f-bb343ffbba4e None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:20.581507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f0b4-3607-45d0-a80f-bb343ffbba4e None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:20.581507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6f0b4-3607-45d0-a80f-bb343ffbba4e None admin] PATH_INFO: `/v3/services` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:20.581507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6f0b4-3607-45d0-a80f-bb343ffbba4e None admin] RBAC: Adding query filter params (type=placement) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:20.581507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6f0b4-3607-45d0-a80f-bb343ffbba4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:20.581507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6f0b4-3607-45d0-a80f-bb343ffbba4e None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:20.581507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 654/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Mar 31 17:57:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:22.860519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf581-d836-4a3f-b162-9a3941137f90 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:22.861080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf581-d836-4a3f-b162-9a3941137f90 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:22.861080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf581-d836-4a3f-b162-9a3941137f90 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:22.862966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 639/1293] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:22.868941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371da36-f15a-43c0-8104-56843c4a6a37 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:22.869354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371da36-f15a-43c0-8104-56843c4a6a37 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:22.869570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371da36-f15a-43c0-8104-56843c4a6a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:22.887147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8371da36-f15a-43c0-8104-56843c4a6a37 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:22.888346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8371da36-f15a-43c0-8104-56843c4a6a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:22.953233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 655/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:57:22.975488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedf581-d836-4a3f-b162-9a3941137f90 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:23.073259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedf581-d836-4a3f-b162-9a3941137f90 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:23.104838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e61e3c-f456-401c-9847-4b0b14b011a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:23.105489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e61e3c-f456-401c-9847-4b0b14b011a6 None admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:23.105770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e61e3c-f456-401c-9847-4b0b14b011a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:23.106040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e61e3c-f456-401c-9847-4b0b14b011a6 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:23.106799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e61e3c-f456-401c-9847-4b0b14b011a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:23.108145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e61e3c-f456-401c-9847-4b0b14b011a6 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:23.282940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 640/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Mar 31 17:57:22 2022] POST /identity/v3/services => generated 246 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 17:57:25.595444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e414dbd-ee5e-44c3-a0b9-c1786f974377 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:25.596002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e414dbd-ee5e-44c3-a0b9-c1786f974377 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:25.596002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e414dbd-ee5e-44c3-a0b9-c1786f974377 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:25.597766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 656/1296] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:25.603601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3914-3764-400f-8b82-f2e51ef38d7a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:25.604022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3914-3764-400f-8b82-f2e51ef38d7a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:25.604170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3914-3764-400f-8b82-f2e51ef38d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:25.622090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b56e3914-3764-400f-8b82-f2e51ef38d7a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:25.623388 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b56e3914-3764-400f-8b82-f2e51ef38d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:25.694221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 641/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 31 17:57:25.717612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e414dbd-ee5e-44c3-a0b9-c1786f974377 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:25.814280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e414dbd-ee5e-44c3-a0b9-c1786f974377 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:25.846121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:25.846878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:25.855053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:25.855053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:25.855053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:25.855053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:25.860659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 31 17:57:25.861791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 657/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:57:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:25.867785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e3914-3764-400f-8b82-f2e51ef38d7a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:25.961962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e3914-3764-400f-8b82-f2e51ef38d7a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:25.994577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:25.995262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:25.995542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:25.995817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:25.996515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:25.996820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:25.998170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:26.003122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 642/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Mar 31 17:57:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:26.009607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:26.105387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad3951-b26c-4279-b3a2-2603de7c0fe7 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:26.136866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36368f5-735c-4ad1-a288-d7d112b9d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:26.137512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36368f5-735c-4ad1-a288-d7d112b9d920 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:26.137794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36368f5-735c-4ad1-a288-d7d112b9d920 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:26.138072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36368f5-735c-4ad1-a288-d7d112b9d920 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:26.138870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36368f5-735c-4ad1-a288-d7d112b9d920 None admin] RBAC: Adding query filter params (interface=public, service_id=987ecfbfc38247568077a21ace8bd411, region_id=RegionOne) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:26.139181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36368f5-735c-4ad1-a288-d7d112b9d920 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:26.140541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36368f5-735c-4ad1-a288-d7d112b9d920 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:26.145814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 658/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Mar 31 17:57:26 2022] GET /identity/v3/endpoints?service_id=987ecfbfc38247568077a21ace8bd411&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 17:57:26.151498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:26.250517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450a56b-d82b-467a-9baa-c130c443b06c None admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:26.285006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929d21c-503a-46af-9a92-0e6e70fcafa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:26.285698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d21c-503a-46af-9a92-0e6e70fcafa8 None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:26.286041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d21c-503a-46af-9a92-0e6e70fcafa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:26.286314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d21c-503a-46af-9a92-0e6e70fcafa8 None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:26.287146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929d21c-503a-46af-9a92-0e6e70fcafa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:26.288503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929d21c-503a-46af-9a92-0e6e70fcafa8 None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:26.295253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 643/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Mar 31 17:57:26 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 17:57:28.617351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006b65-7a11-4857-b55d-9d9dd0437546 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:28.617928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006b65-7a11-4857-b55d-9d9dd0437546 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:28.617928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006b65-7a11-4857-b55d-9d9dd0437546 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:28.619789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 659/1302] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 17:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 17:57:28.625105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ac4ae-ff26-4b6d-96bc-38fc03ca591f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:28.626964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ac4ae-ff26-4b6d-96bc-38fc03ca591f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:28.626964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ac4ae-ff26-4b6d-96bc-38fc03ca591f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:28.643842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0d6ac4ae-ff26-4b6d-96bc-38fc03ca591f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 17:57:28.645067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d6ac4ae-ff26-4b6d-96bc-38fc03ca591f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 17:57:28.711161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 644/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 17:57:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 31 17:57:28.734651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006b65-7a11-4857-b55d-9d9dd0437546 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:28.834948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006b65-7a11-4857-b55d-9d9dd0437546 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:28.867459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:28.868185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:28.868465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:28.868740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:28.869409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:28.870794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:28.882002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING keystone.server.flask.application [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 31 17:57:28.886732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 660/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Mar 31 17:57:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 31 17:57:28.889347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ac4ae-ff26-4b6d-96bc-38fc03ca591f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:28.984126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ac4ae-ff26-4b6d-96bc-38fc03ca591f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:29.016779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b8d99-4698-4cc3-93e7-24a59efc8f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:29.017438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8d99-4698-4cc3-93e7-24a59efc8f2a None admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:29.017717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8d99-4698-4cc3-93e7-24a59efc8f2a None admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:29.018061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8d99-4698-4cc3-93e7-24a59efc8f2a None admin] PATH_INFO: `/v3/services` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:29.018783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8d99-4698-4cc3-93e7-24a59efc8f2a None admin] RBAC: Adding query filter params (name=placement) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 17:57:29.019085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8d99-4698-4cc3-93e7-24a59efc8f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:29.021149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8d99-4698-4cc3-93e7-24a59efc8f2a None admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:29.026083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 645/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Mar 31 17:57:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 17:57:29.032128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 17:57:29.127362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad2672-4b7e-43ba-a52c-fd0e34fc2f70 None admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 17:57:29.159015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3ce81-21e8-417d-94b5-2b2eba0ef7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 17:57:29.159665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ce81-21e8-417d-94b5-2b2eba0ef7bd None admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 17:57:29.159944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ce81-21e8-417d-94b5-2b2eba0ef7bd None admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 17:57:29.160217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ce81-21e8-417d-94b5-2b2eba0ef7bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 17:57:29.161584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3ce81-21e8-417d-94b5-2b2eba0ef7bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 17:57:29.162950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3ce81-21e8-417d-94b5-2b2eba0ef7bd None admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 17:57:29.248353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 661/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Mar 31 17:57:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:05:02.095523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1d4be-c2d7-4d09-966a-6b2019394143 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:02.096005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1d4be-c2d7-4d09-966a-6b2019394143 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:02.096093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1d4be-c2d7-4d09-966a-6b2019394143 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:02.097851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 646/1307] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:02.103327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac689eb-8c20-44f0-9d9a-3411e9d99278 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:02.103750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac689eb-8c20-44f0-9d9a-3411e9d99278 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:02.103938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac689eb-8c20-44f0-9d9a-3411e9d99278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:02.183365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-dac689eb-8c20-44f0-9d9a-3411e9d99278 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:02.183365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-dac689eb-8c20-44f0-9d9a-3411e9d99278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:02.287493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 662/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:05:02.343264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81d951-eccc-4d6a-84d2-e1e9fa08efd1 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:02.344045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81d951-eccc-4d6a-84d2-e1e9fa08efd1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:02.344592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81d951-eccc-4d6a-84d2-e1e9fa08efd1 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:02.348705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 647/1309] 10.222.0.58 () {54 vars in 963 bytes} [Thu Mar 31 18:05:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:02.353879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a27da9-0a4b-4d50-a32d-81c1f563db08 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:02.354169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a27da9-0a4b-4d50-a32d-81c1f563db08 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:02.354656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a27da9-0a4b-4d50-a32d-81c1f563db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:02.439812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f6a27da9-0a4b-4d50-a32d-81c1f563db08 None None] MFA Rules not processed for user `7436a3068f6545a4b74c877c5b8c81c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:02.441913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f6a27da9-0a4b-4d50-a32d-81c1f563db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:02.524794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 663/1310] 10.222.0.58 () {58 vars in 1060 bytes} [Thu Mar 31 18:05:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:02.534811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81d951-eccc-4d6a-84d2-e1e9fa08efd1 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:02.536930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7f81d951-eccc-4d6a-84d2-e1e9fa08efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:02.654824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81d951-eccc-4d6a-84d2-e1e9fa08efd1 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:02.729039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b2c30-c6ea-4ccc-89fc-2e521b6063b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:02.729696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2c30-c6ea-4ccc-89fc-2e521b6063b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:02.729978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2c30-c6ea-4ccc-89fc-2e521b6063b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:02.730254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2c30-c6ea-4ccc-89fc-2e521b6063b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:02.731928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7a9b2c30-c6ea-4ccc-89fc-2e521b6063b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:02.846998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b2c30-c6ea-4ccc-89fc-2e521b6063b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:02.848492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b2c30-c6ea-4ccc-89fc-2e521b6063b7 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:02.867759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 648/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:05:05.446684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262a447-bc61-428d-a266-096f63ce9be8 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:05.447197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262a447-bc61-428d-a266-096f63ce9be8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:05.447197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262a447-bc61-428d-a266-096f63ce9be8 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:05.448912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 664/1312] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:05.454660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074e391-f87c-4842-8608-849af9fc46c6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:05.455088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074e391-f87c-4842-8608-849af9fc46c6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:05.455221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074e391-f87c-4842-8608-849af9fc46c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:05.534657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4074e391-f87c-4842-8608-849af9fc46c6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:05.535849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4074e391-f87c-4842-8608-849af9fc46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:05.629268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 649/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:05.667178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262a447-bc61-428d-a266-096f63ce9be8 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:05.668802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2262a447-bc61-428d-a266-096f63ce9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:05.770292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262a447-bc61-428d-a266-096f63ce9be8 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:05.839989 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41e91c-3649-417a-9b61-0873368a35ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:05.840641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e91c-3649-417a-9b61-0873368a35ac service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:05.840922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e91c-3649-417a-9b61-0873368a35ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:05.841196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e91c-3649-417a-9b61-0873368a35ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:05.842856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0c41e91c-3649-417a-9b61-0873368a35ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:05.951980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41e91c-3649-417a-9b61-0873368a35ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:05.954237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41e91c-3649-417a-9b61-0873368a35ac service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:05.972302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 665/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:08.910924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d962-d083-4408-9762-2a2b40cc0122 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:08.911454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d962-d083-4408-9762-2a2b40cc0122 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:08.911454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d962-d083-4408-9762-2a2b40cc0122 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:08.913296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 650/1315] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:08.919240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa18f25-7f75-4487-9fbb-07f7f7959e62 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:08.919776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa18f25-7f75-4487-9fbb-07f7f7959e62 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:08.919936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa18f25-7f75-4487-9fbb-07f7f7959e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:08.984859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9aa18f25-7f75-4487-9fbb-07f7f7959e62 None None] MFA Rules not processed for user `87e005b975a34a64a110e48a187b85dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:08.986258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9aa18f25-7f75-4487-9fbb-07f7f7959e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:09.081749 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 666/1316] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:09.121157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d962-d083-4408-9762-2a2b40cc0122 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:09.122714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8bc5d962-d083-4408-9762-2a2b40cc0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:09.221908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d962-d083-4408-9762-2a2b40cc0122 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:09.294225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e2a04-4cb0-40c0-9a1c-15e2423998bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:09.294911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2a04-4cb0-40c0-9a1c-15e2423998bd service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:09.295193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2a04-4cb0-40c0-9a1c-15e2423998bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:09.295468 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2a04-4cb0-40c0-9a1c-15e2423998bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:09.297923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-040e2a04-4cb0-40c0-9a1c-15e2423998bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:09.405404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e2a04-4cb0-40c0-9a1c-15e2423998bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:09.407388 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e2a04-4cb0-40c0-9a1c-15e2423998bd service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:09.425370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 651/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:12.497897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaeb41-b5c8-44cf-9e6b-1de1d210a390 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:12.498419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaeb41-b5c8-44cf-9e6b-1de1d210a390 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:12.498419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaeb41-b5c8-44cf-9e6b-1de1d210a390 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:12.500407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 667/1318] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:12.505582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4283-3187-41a0-b8df-4a771796b660 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:12.506002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4283-3187-41a0-b8df-4a771796b660 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:12.506134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4283-3187-41a0-b8df-4a771796b660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:12.568286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-543b4283-3187-41a0-b8df-4a771796b660 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:12.569464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-543b4283-3187-41a0-b8df-4a771796b660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:12.661117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 652/1319] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:12.700704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaeb41-b5c8-44cf-9e6b-1de1d210a390 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:12.702238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9aeaeb41-b5c8-44cf-9e6b-1de1d210a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:12.803834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaeb41-b5c8-44cf-9e6b-1de1d210a390 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:12.875581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a294c-3271-4021-8b8a-a378ff9338e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:12.876220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a294c-3271-4021-8b8a-a378ff9338e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:12.876503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a294c-3271-4021-8b8a-a378ff9338e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:12.876780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a294c-3271-4021-8b8a-a378ff9338e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:12.878420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ed0a294c-3271-4021-8b8a-a378ff9338e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:12.982103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a294c-3271-4021-8b8a-a378ff9338e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:12.983550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a294c-3271-4021-8b8a-a378ff9338e2 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:13.001359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 668/1320] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:16.404659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c83c-006e-42a2-afd0-ed3d757ffe96 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:16.405182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c83c-006e-42a2-afd0-ed3d757ffe96 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:16.405182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c83c-006e-42a2-afd0-ed3d757ffe96 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:16.407052 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 653/1321] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:16.412254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80cfb-11ba-4a7a-b593-fad4e0951330 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:16.412676 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80cfb-11ba-4a7a-b593-fad4e0951330 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:16.412812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80cfb-11ba-4a7a-b593-fad4e0951330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:16.476993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8ba80cfb-11ba-4a7a-b593-fad4e0951330 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:16.478198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8ba80cfb-11ba-4a7a-b593-fad4e0951330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:16.572459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 669/1322] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:16.621896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30b7e-878f-4464-b948-8b41cb06e849 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:16.622219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30b7e-878f-4464-b948-8b41cb06e849 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:16.622504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30b7e-878f-4464-b948-8b41cb06e849 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:16.624367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 654/1323] 10.222.0.58 () {54 vars in 963 bytes} [Thu Mar 31 18:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:16.630767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44f5c-e801-4d50-be69-d3c10d27d667 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:16.631053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44f5c-e801-4d50-be69-d3c10d27d667 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:16.631325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44f5c-e801-4d50-be69-d3c10d27d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:16.703037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f3c44f5c-e801-4d50-be69-d3c10d27d667 None None] MFA Rules not processed for user `7436a3068f6545a4b74c877c5b8c81c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:16.704120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f3c44f5c-e801-4d50-be69-d3c10d27d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:16.779202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 670/1324] 10.222.0.58 () {58 vars in 1060 bytes} [Thu Mar 31 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:05:16.788733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30b7e-878f-4464-b948-8b41cb06e849 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:16.790428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cfc30b7e-878f-4464-b948-8b41cb06e849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:16.890800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30b7e-878f-4464-b948-8b41cb06e849 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:16.962696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd9d0c-cafd-4ff4-a538-b24338a70a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:16.963279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd9d0c-cafd-4ff4-a538-b24338a70a0e service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:16.963558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd9d0c-cafd-4ff4-a538-b24338a70a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:16.963829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd9d0c-cafd-4ff4-a538-b24338a70a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:16.965466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a1fd9d0c-cafd-4ff4-a538-b24338a70a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:17.071492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd9d0c-cafd-4ff4-a538-b24338a70a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:17.072915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd9d0c-cafd-4ff4-a538-b24338a70a0e service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:17.090439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 655/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:19.699057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7d73-a54e-4962-ab5a-fa5e8775e113 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:19.699599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7d73-a54e-4962-ab5a-fa5e8775e113 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:19.699599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7d73-a54e-4962-ab5a-fa5e8775e113 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:19.701394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 671/1326] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:19.707291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8df2-a605-4668-a7f5-997e5328667e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:19.707711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8df2-a605-4668-a7f5-997e5328667e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:19.707877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8df2-a605-4668-a7f5-997e5328667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:19.775794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7a0c8df2-a605-4668-a7f5-997e5328667e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:19.776988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7a0c8df2-a605-4668-a7f5-997e5328667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:19.867720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 656/1327] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:19.903952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7d73-a54e-4962-ab5a-fa5e8775e113 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:19.905478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-076d7d73-a54e-4962-ab5a-fa5e8775e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:20.007922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7d73-a54e-4962-ab5a-fa5e8775e113 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:20.080929 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fb4d6-07c9-46f5-90c3-1a296cb7f307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:20.081581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb4d6-07c9-46f5-90c3-1a296cb7f307 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:20.081862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb4d6-07c9-46f5-90c3-1a296cb7f307 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:20.082140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb4d6-07c9-46f5-90c3-1a296cb7f307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:20.083827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2e6fb4d6-07c9-46f5-90c3-1a296cb7f307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:20.190962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb4d6-07c9-46f5-90c3-1a296cb7f307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:20.192311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb4d6-07c9-46f5-90c3-1a296cb7f307 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:20.209805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 672/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:22.565392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58416b9-f3b2-46ad-baf6-166216584bb6 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:22.566004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58416b9-f3b2-46ad-baf6-166216584bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:22.566004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58416b9-f3b2-46ad-baf6-166216584bb6 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:22.567766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 657/1329] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 18:05:22.572865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb124072-7b00-4f93-9550-79c788ffb301 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:22.573265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb124072-7b00-4f93-9550-79c788ffb301 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:22.573427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb124072-7b00-4f93-9550-79c788ffb301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:22.639658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-bb124072-7b00-4f93-9550-79c788ffb301 None None] MFA Rules not processed for user `87e005b975a34a64a110e48a187b85dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:22.640843 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bb124072-7b00-4f93-9550-79c788ffb301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:22.733109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 673/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:22.771786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58416b9-f3b2-46ad-baf6-166216584bb6 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:22.773320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a58416b9-f3b2-46ad-baf6-166216584bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:22.872006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58416b9-f3b2-46ad-baf6-166216584bb6 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:22.942427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91439fe6-dad9-4cf2-8b39-46c310bb42a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:22.943133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439fe6-dad9-4cf2-8b39-46c310bb42a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:22.943412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439fe6-dad9-4cf2-8b39-46c310bb42a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:22.943684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439fe6-dad9-4cf2-8b39-46c310bb42a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:22.945305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-91439fe6-dad9-4cf2-8b39-46c310bb42a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:23.049110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91439fe6-dad9-4cf2-8b39-46c310bb42a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:23.050540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91439fe6-dad9-4cf2-8b39-46c310bb42a7 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:23.068889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 658/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:25.929851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbfa47-f1de-4114-bd84-1d43cd135300 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:25.930312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbfa47-f1de-4114-bd84-1d43cd135300 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:25.930406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbfa47-f1de-4114-bd84-1d43cd135300 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:25.932328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 674/1332] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:25.938639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71b81-7a5f-48a6-83c4-17fba4ee49b9 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:25.939080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71b81-7a5f-48a6-83c4-17fba4ee49b9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:25.939257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71b81-7a5f-48a6-83c4-17fba4ee49b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:26.007616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-28d71b81-7a5f-48a6-83c4-17fba4ee49b9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:26.008843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-28d71b81-7a5f-48a6-83c4-17fba4ee49b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:26.105346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 659/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:26.143650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbfa47-f1de-4114-bd84-1d43cd135300 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:26.145264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-62cbfa47-f1de-4114-bd84-1d43cd135300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:26.249606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbfa47-f1de-4114-bd84-1d43cd135300 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:26.323476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1473d6d-e22a-4137-99b6-04bc6f60b81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:26.324146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1473d6d-e22a-4137-99b6-04bc6f60b81e service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:26.324430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1473d6d-e22a-4137-99b6-04bc6f60b81e service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:26.324707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1473d6d-e22a-4137-99b6-04bc6f60b81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:26.326351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c1473d6d-e22a-4137-99b6-04bc6f60b81e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:26.434067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1473d6d-e22a-4137-99b6-04bc6f60b81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:26.435523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1473d6d-e22a-4137-99b6-04bc6f60b81e service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:26.453408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 675/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:28.804740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a85aa-de29-4193-bec5-81b8b8949778 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:28.805472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a85aa-de29-4193-bec5-81b8b8949778 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:28.805472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a85aa-de29-4193-bec5-81b8b8949778 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:28.807138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 660/1335] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 18:05:28.813125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c5bf-cefa-4036-bdcb-a6bf837ca086 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:28.813750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c5bf-cefa-4036-bdcb-a6bf837ca086 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:28.813750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c5bf-cefa-4036-bdcb-a6bf837ca086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:28.880137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-3730c5bf-cefa-4036-bdcb-a6bf837ca086 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:28.881342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3730c5bf-cefa-4036-bdcb-a6bf837ca086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:28.977896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 676/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:29.018807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a85aa-de29-4193-bec5-81b8b8949778 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:29.020389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d94a85aa-de29-4193-bec5-81b8b8949778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:29.124423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a85aa-de29-4193-bec5-81b8b8949778 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:29.195292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b46ef-041f-45b0-9589-22a99a6b0f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:29.195937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b46ef-041f-45b0-9589-22a99a6b0f09 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:29.196213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b46ef-041f-45b0-9589-22a99a6b0f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:29.196483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b46ef-041f-45b0-9589-22a99a6b0f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:29.198338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-419b46ef-041f-45b0-9589-22a99a6b0f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:29.301928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b46ef-041f-45b0-9589-22a99a6b0f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:29.303528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b46ef-041f-45b0-9589-22a99a6b0f09 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:29.322502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 661/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:32.585421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2f0bc-b20c-40ca-a662-d7348ca796a6 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:32.585990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2f0bc-b20c-40ca-a662-d7348ca796a6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:32.585990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2f0bc-b20c-40ca-a662-d7348ca796a6 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:32.587810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 677/1338] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:32.592982 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3cdad-1fc6-4b99-b09a-c391c3f24ce3 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:32.593390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3cdad-1fc6-4b99-b09a-c391c3f24ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:32.593534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3cdad-1fc6-4b99-b09a-c391c3f24ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:32.660915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f6c3cdad-1fc6-4b99-b09a-c391c3f24ce3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:32.662016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f6c3cdad-1fc6-4b99-b09a-c391c3f24ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:32.763836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 662/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:32.800158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2f0bc-b20c-40ca-a662-d7348ca796a6 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:32.802233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c1e2f0bc-b20c-40ca-a662-d7348ca796a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:32.894748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2f0bc-b20c-40ca-a662-d7348ca796a6 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:32.898453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e370edc-9aa2-40aa-8cff-adcf280fef00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:32.899132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370edc-9aa2-40aa-8cff-adcf280fef00 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:32.899413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370edc-9aa2-40aa-8cff-adcf280fef00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:32.899689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e370edc-9aa2-40aa-8cff-adcf280fef00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:32.910144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e370edc-9aa2-40aa-8cff-adcf280fef00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:32.911805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e370edc-9aa2-40aa-8cff-adcf280fef00 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:32.921229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 678/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:37.727536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa669316-0f51-44e1-8ff7-c8332efbb776 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:37.728056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa669316-0f51-44e1-8ff7-c8332efbb776 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:37.728056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa669316-0f51-44e1-8ff7-c8332efbb776 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:37.729857 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 663/1341] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 18:05:37.735524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22a4a-58eb-4303-82c0-fdc3128877ea None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:37.736161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22a4a-58eb-4303-82c0-fdc3128877ea None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:37.736161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22a4a-58eb-4303-82c0-fdc3128877ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:37.778150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-20b22a4a-58eb-4303-82c0-fdc3128877ea None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:37.779570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-20b22a4a-58eb-4303-82c0-fdc3128877ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:37.856417 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 679/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:37.895883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa669316-0f51-44e1-8ff7-c8332efbb776 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:37.897576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fa669316-0f51-44e1-8ff7-c8332efbb776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:37.910858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa669316-0f51-44e1-8ff7-c8332efbb776 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:37.914279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90beb5f-8629-46cc-94e6-e41c443422c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:37.914954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90beb5f-8629-46cc-94e6-e41c443422c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:37.915231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90beb5f-8629-46cc-94e6-e41c443422c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:37.915499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90beb5f-8629-46cc-94e6-e41c443422c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:37.924434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90beb5f-8629-46cc-94e6-e41c443422c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:37.925999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90beb5f-8629-46cc-94e6-e41c443422c3 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:37.935157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 664/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:41.245225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195315c-d53f-4582-9a33-33de0649b860 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:41.245770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195315c-d53f-4582-9a33-33de0649b860 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:41.245770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195315c-d53f-4582-9a33-33de0649b860 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:41.247635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 680/1344] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:41.253644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171819f4-74bb-48db-a62c-f5643dd01138 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:41.254070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171819f4-74bb-48db-a62c-f5643dd01138 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:41.254200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171819f4-74bb-48db-a62c-f5643dd01138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:41.272904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-171819f4-74bb-48db-a62c-f5643dd01138 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:41.274101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-171819f4-74bb-48db-a62c-f5643dd01138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:41.282522 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 665/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:41.320663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195315c-d53f-4582-9a33-33de0649b860 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:41.331469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195315c-d53f-4582-9a33-33de0649b860 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:41.335039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c7057-6be7-4441-8ea8-e5d2c9a83c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:41.335735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7057-6be7-4441-8ea8-e5d2c9a83c4f service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:41.336103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7057-6be7-4441-8ea8-e5d2c9a83c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:41.336439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7057-6be7-4441-8ea8-e5d2c9a83c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:41.345518 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c7057-6be7-4441-8ea8-e5d2c9a83c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:41.346995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c7057-6be7-4441-8ea8-e5d2c9a83c4f service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:41.356176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 681/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:46.088255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658ff5-3910-4c1a-adc5-91eac98add68 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:46.088911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658ff5-3910-4c1a-adc5-91eac98add68 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:46.088911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658ff5-3910-4c1a-adc5-91eac98add68 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:46.090820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 666/1347] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:46.097746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861b814-8435-4d46-9b77-673c79bc1821 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:46.098316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861b814-8435-4d46-9b77-673c79bc1821 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:46.100208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861b814-8435-4d46-9b77-673c79bc1821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:46.123013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d861b814-8435-4d46-9b77-673c79bc1821 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:46.124203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d861b814-8435-4d46-9b77-673c79bc1821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:46.132843 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 682/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:05:46.172150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f658ff5-3910-4c1a-adc5-91eac98add68 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:05:46.185546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f658ff5-3910-4c1a-adc5-91eac98add68 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:05:46.189288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104f2be-1ac2-4a88-bd09-fa8520c2005c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:05:46.189973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f2be-1ac2-4a88-bd09-fa8520c2005c service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:46.190255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f2be-1ac2-4a88-bd09-fa8520c2005c service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:46.190759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f2be-1ac2-4a88-bd09-fa8520c2005c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:46.199687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104f2be-1ac2-4a88-bd09-fa8520c2005c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:05:46.201105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104f2be-1ac2-4a88-bd09-fa8520c2005c service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:05:46.210455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 667/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:05:52.236533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3fa4-a978-4fa7-a7df-423184027df2 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:52.237928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3fa4-a978-4fa7-a7df-423184027df2 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:52.237928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3fa4-a978-4fa7-a7df-423184027df2 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:52.241767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 683/1350] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:05:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:52.247573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ad7a-1f11-46c5-b3b5-e795e9112b78 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:52.248141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ad7a-1f11-46c5-b3b5-e795e9112b78 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:52.248551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ad7a-1f11-46c5-b3b5-e795e9112b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:52.333430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5aa1ad7a-1f11-46c5-b3b5-e795e9112b78 None None] MFA Rules not processed for user `511e982844c347c8bd49f51aaf29be71`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:52.334954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5aa1ad7a-1f11-46c5-b3b5-e795e9112b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:52.428564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 668/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:57.408466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f547e69-651a-4839-bbf4-c30e0c2c953f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:57.409002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f547e69-651a-4839-bbf4-c30e0c2c953f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:57.409002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f547e69-651a-4839-bbf4-c30e0c2c953f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:57.410738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 684/1352] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:57.416799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f9c-f606-4b22-b76e-b6ab010fd9ed None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:57.417238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f9c-f606-4b22-b76e-b6ab010fd9ed None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:57.417367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f9c-f606-4b22-b76e-b6ab010fd9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:57.436600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-3d775f9c-f606-4b22-b76e-b6ab010fd9ed None None] MFA Rules not processed for user `511e982844c347c8bd49f51aaf29be71`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:57.437787 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3d775f9c-f606-4b22-b76e-b6ab010fd9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:57.448087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 669/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:05:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:05:59.179165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bde6b-d7b7-4bfb-b792-a03c5aeb5585 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:59.179645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bde6b-d7b7-4bfb-b792-a03c5aeb5585 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:59.179857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bde6b-d7b7-4bfb-b792-a03c5aeb5585 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:59.181861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 685/1354] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:05:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:05:59.187306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890106-b5e7-4721-845d-ed8f981ea3cd None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:05:59.187747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890106-b5e7-4721-845d-ed8f981ea3cd None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:05:59.187999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890106-b5e7-4721-845d-ed8f981ea3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:05:59.207806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-02890106-b5e7-4721-845d-ed8f981ea3cd None None] MFA Rules not processed for user `511e982844c347c8bd49f51aaf29be71`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:05:59.209223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-02890106-b5e7-4721-845d-ed8f981ea3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:05:59.217950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 670/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:05:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:03.607576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1ebe-5bff-4735-9f62-65537133a7de None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:03.608174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1ebe-5bff-4735-9f62-65537133a7de None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:03.608419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1ebe-5bff-4735-9f62-65537133a7de None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:03.612255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 686/1356] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:03.619805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5398b0-88d7-4e8c-b21d-31172715dc04 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:03.620256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5398b0-88d7-4e8c-b21d-31172715dc04 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:03.620655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5398b0-88d7-4e8c-b21d-31172715dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:03.642480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6d5398b0-88d7-4e8c-b21d-31172715dc04 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:03.643682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6d5398b0-88d7-4e8c-b21d-31172715dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:03.658974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 671/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:03.698596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac2df-6c3c-4f79-963b-af158ff7f4cd None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:03.698922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac2df-6c3c-4f79-963b-af158ff7f4cd None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:03.699197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac2df-6c3c-4f79-963b-af158ff7f4cd None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:03.701073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 687/1358] 10.222.0.58 () {54 vars in 960 bytes} [Thu Mar 31 18:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:03.707397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc355-35c7-40d0-93b4-f27024dc739b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:03.707791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc355-35c7-40d0-93b4-f27024dc739b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:03.708167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc355-35c7-40d0-93b4-f27024dc739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:03.757552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a8cbc355-35c7-40d0-93b4-f27024dc739b None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:03.759238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a8cbc355-35c7-40d0-93b4-f27024dc739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:03.855769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 672/1359] 10.222.0.58 () {58 vars in 1057 bytes} [Thu Mar 31 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:03.864304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac2df-6c3c-4f79-963b-af158ff7f4cd None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:03.878258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac2df-6c3c-4f79-963b-af158ff7f4cd None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:03.883565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb72bc-d945-4f1c-8df1-16d766ad2935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:03.884202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb72bc-d945-4f1c-8df1-16d766ad2935 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:03.884484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb72bc-d945-4f1c-8df1-16d766ad2935 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:03.884754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb72bc-d945-4f1c-8df1-16d766ad2935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:03.894035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb72bc-d945-4f1c-8df1-16d766ad2935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:03.895632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb72bc-d945-4f1c-8df1-16d766ad2935 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:03.906501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 688/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:06.552178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd814-06cf-4e35-9552-fcb98abf5bf1 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:06.552669 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd814-06cf-4e35-9552-fcb98abf5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:06.552669 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd814-06cf-4e35-9552-fcb98abf5bf1 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:06.554588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 673/1361] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:06.559788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc40c1-2302-4857-9a23-c88bfc58bcba None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:06.560230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc40c1-2302-4857-9a23-c88bfc58bcba None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:06.560348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc40c1-2302-4857-9a23-c88bfc58bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:06.583203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1dfc40c1-2302-4857-9a23-c88bfc58bcba None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:06.584784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1dfc40c1-2302-4857-9a23-c88bfc58bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:06.592933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 689/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:06.649206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd814-06cf-4e35-9552-fcb98abf5bf1 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:06.665065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd814-06cf-4e35-9552-fcb98abf5bf1 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:06.670591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b32cf-8467-441a-9818-227b6c13e79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:06.671258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b32cf-8467-441a-9818-227b6c13e79a service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:06.671535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b32cf-8467-441a-9818-227b6c13e79a service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:06.671806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b32cf-8467-441a-9818-227b6c13e79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:06.680722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b32cf-8467-441a-9818-227b6c13e79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:06.682278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b32cf-8467-441a-9818-227b6c13e79a service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:06.693580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 674/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:09.516063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1912-5e12-47e7-9dd9-c72bf2679549 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:09.516602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1912-5e12-47e7-9dd9-c72bf2679549 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:09.516602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1912-5e12-47e7-9dd9-c72bf2679549 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:09.519204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 690/1364] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:09.524516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90946b6-56ff-441a-8a31-65141a5574c4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:09.525161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90946b6-56ff-441a-8a31-65141a5574c4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:09.525449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90946b6-56ff-441a-8a31-65141a5574c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:09.543463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b90946b6-56ff-441a-8a31-65141a5574c4 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:09.544662 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b90946b6-56ff-441a-8a31-65141a5574c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:09.553215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 675/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:09.600051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2112-abce-4cd2-bb11-5ef0359e23cc None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:09.600621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2112-abce-4cd2-bb11-5ef0359e23cc None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:09.601113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2112-abce-4cd2-bb11-5ef0359e23cc None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:09.603081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 691/1366] 10.222.0.58 () {54 vars in 960 bytes} [Thu Mar 31 18:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:09.608680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3894eb-c650-4da5-913b-6302a1759926 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:09.608970 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3894eb-c650-4da5-913b-6302a1759926 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:09.610442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3894eb-c650-4da5-913b-6302a1759926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:09.628755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ce3894eb-c650-4da5-913b-6302a1759926 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:09.629943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ce3894eb-c650-4da5-913b-6302a1759926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:09.639323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 676/1367] 10.222.0.58 () {58 vars in 1057 bytes} [Thu Mar 31 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:06:09.647634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2112-abce-4cd2-bb11-5ef0359e23cc None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:09.662378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2112-abce-4cd2-bb11-5ef0359e23cc None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:09.668004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a342c-d1ca-4ee7-8920-6784dc2e59f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:09.668643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a342c-d1ca-4ee7-8920-6784dc2e59f1 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:09.668923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a342c-d1ca-4ee7-8920-6784dc2e59f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:09.669196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a342c-d1ca-4ee7-8920-6784dc2e59f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:09.678173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a342c-d1ca-4ee7-8920-6784dc2e59f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:09.682647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a342c-d1ca-4ee7-8920-6784dc2e59f1 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:09.691698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 692/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:12.316086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6ff6-81ad-41d7-8eff-d8e981754fc5 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.317180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6ff6-81ad-41d7-8eff-d8e981754fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.317676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6ff6-81ad-41d7-8eff-d8e981754fc5 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.319720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 677/1369] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:12.325442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a15d2b-83d0-4d00-9250-f71725f7c66b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.326259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a15d2b-83d0-4d00-9250-f71725f7c66b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.326782 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a15d2b-83d0-4d00-9250-f71725f7c66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.331816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163421-f804-4e3b-b6f8-1833be1052b1 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.332111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163421-f804-4e3b-b6f8-1833be1052b1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.332568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163421-f804-4e3b-b6f8-1833be1052b1 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.338522 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 678/1370] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 18:06:12.340140 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c626a-5b64-42bb-925d-9b7b5c23a019 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.340599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c626a-5b64-42bb-925d-9b7b5c23a019 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.341026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c626a-5b64-42bb-925d-9b7b5c23a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.347905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b6a15d2b-83d0-4d00-9250-f71725f7c66b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:12.349361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b6a15d2b-83d0-4d00-9250-f71725f7c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:12.360276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 693/1371] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:12.361423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-314c626a-5b64-42bb-925d-9b7b5c23a019 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:12.363018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-314c626a-5b64-42bb-925d-9b7b5c23a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:12.371222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 679/1372] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:12.419816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a15d2b-83d0-4d00-9250-f71725f7c66b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:12.434343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a15d2b-83d0-4d00-9250-f71725f7c66b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:12.441474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a495e0-0d98-4160-8a43-7a4175a29c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:12.442452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a495e0-0d98-4160-8a43-7a4175a29c00 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.443006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a495e0-0d98-4160-8a43-7a4175a29c00 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.443491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a495e0-0d98-4160-8a43-7a4175a29c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.453606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a495e0-0d98-4160-8a43-7a4175a29c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:12.456371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a495e0-0d98-4160-8a43-7a4175a29c00 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:12.479031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 694/1373] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:12.661534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca08c-a428-484c-a374-17777b1c68c1 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.661827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca08c-a428-484c-a374-17777b1c68c1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.662112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca08c-a428-484c-a374-17777b1c68c1 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.664055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 680/1374] 10.222.0.58 () {54 vars in 962 bytes} [Thu Mar 31 18:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 18:06:12.669296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131aec-3194-4e5b-a508-f6c80ac6a58a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.669586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131aec-3194-4e5b-a508-f6c80ac6a58a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.669865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131aec-3194-4e5b-a508-f6c80ac6a58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.724402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c7131aec-3194-4e5b-a508-f6c80ac6a58a None None] MFA Rules not processed for user `95559d1e48934be89e562208ff65d195`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:12.725760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c7131aec-3194-4e5b-a508-f6c80ac6a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:12.798824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 695/1375] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Mar 31 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:12.808411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ca08c-a428-484c-a374-17777b1c68c1 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:12.821401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ca08c-a428-484c-a374-17777b1c68c1 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:12.825333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504b9bc-c975-42bf-89f3-24b4df3adc89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:12.825936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b9bc-c975-42bf-89f3-24b4df3adc89 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:12.826220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b9bc-c975-42bf-89f3-24b4df3adc89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:12.826495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504b9bc-c975-42bf-89f3-24b4df3adc89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:12.837833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504b9bc-c975-42bf-89f3-24b4df3adc89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:12.839355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504b9bc-c975-42bf-89f3-24b4df3adc89 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:12.851172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 681/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:15.055883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc070-a5a5-493b-9b33-15fbb757f174 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:15.055883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc070-a5a5-493b-9b33-15fbb757f174 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:15.055883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc070-a5a5-493b-9b33-15fbb757f174 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:15.057568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 696/1377] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:15.063116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fda3f-82a2-41bc-b9b7-70bb259e92d9 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:15.063549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fda3f-82a2-41bc-b9b7-70bb259e92d9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:15.063679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fda3f-82a2-41bc-b9b7-70bb259e92d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:15.088075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f71fda3f-82a2-41bc-b9b7-70bb259e92d9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:15.089277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f71fda3f-82a2-41bc-b9b7-70bb259e92d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:15.098584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 682/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:15.144458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc070-a5a5-493b-9b33-15fbb757f174 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:15.160744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc070-a5a5-493b-9b33-15fbb757f174 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:15.168017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c00e02-f00a-4960-839a-520069076e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:15.168778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00e02-f00a-4960-839a-520069076e8d service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:15.169129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00e02-f00a-4960-839a-520069076e8d service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:15.169482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00e02-f00a-4960-839a-520069076e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:15.178911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c00e02-f00a-4960-839a-520069076e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:15.186440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c00e02-f00a-4960-839a-520069076e8d service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:15.198196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 697/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:18.060342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a499-bbcd-416d-ad4f-42c3f0e5cac3 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:18.061317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a499-bbcd-416d-ad4f-42c3f0e5cac3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:18.061831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a499-bbcd-416d-ad4f-42c3f0e5cac3 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:18.064159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 683/1380] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 18:06:18.069845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238513b-2b9b-4b91-b4ae-1fb21cacac69 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:18.071534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238513b-2b9b-4b91-b4ae-1fb21cacac69 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:18.071534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238513b-2b9b-4b91-b4ae-1fb21cacac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:18.090130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1238513b-2b9b-4b91-b4ae-1fb21cacac69 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:18.091679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1238513b-2b9b-4b91-b4ae-1fb21cacac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:18.100902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 698/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:18.148008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a499-bbcd-416d-ad4f-42c3f0e5cac3 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:18.164073 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a499-bbcd-416d-ad4f-42c3f0e5cac3 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:18.169963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45392f-a718-4ecb-8507-b3b010775087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:18.170739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45392f-a718-4ecb-8507-b3b010775087 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:18.171201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45392f-a718-4ecb-8507-b3b010775087 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:18.171625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45392f-a718-4ecb-8507-b3b010775087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:18.180883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45392f-a718-4ecb-8507-b3b010775087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:18.182803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45392f-a718-4ecb-8507-b3b010775087 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:18.194826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 684/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:20.780734 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c637da-c3ef-4148-a74e-4895063b8447 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:20.781269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c637da-c3ef-4148-a74e-4895063b8447 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:20.781512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c637da-c3ef-4148-a74e-4895063b8447 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:20.784638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 699/1383] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:20.790069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3e12-bbd9-4a36-ab33-b5bbf911a680 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:20.791066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3e12-bbd9-4a36-ab33-b5bbf911a680 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:20.791203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3e12-bbd9-4a36-ab33-b5bbf911a680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:20.809880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0b5c3e12-bbd9-4a36-ab33-b5bbf911a680 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:20.811078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0b5c3e12-bbd9-4a36-ab33-b5bbf911a680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:20.818934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 685/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:20.863774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c637da-c3ef-4148-a74e-4895063b8447 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:20.878794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c637da-c3ef-4148-a74e-4895063b8447 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:20.886895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4c040-8659-4310-8fae-35cf380cabda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:20.887580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4c040-8659-4310-8fae-35cf380cabda service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:20.887862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4c040-8659-4310-8fae-35cf380cabda service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:20.888137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4c040-8659-4310-8fae-35cf380cabda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:20.898921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4c040-8659-4310-8fae-35cf380cabda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:20.900511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4c040-8659-4310-8fae-35cf380cabda service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:20.910936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 700/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:23.328242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28585734-4740-4995-8344-7dc0cb4d3e5b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:23.328974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28585734-4740-4995-8344-7dc0cb4d3e5b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:23.328974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28585734-4740-4995-8344-7dc0cb4d3e5b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:23.331314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 686/1386] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:23.336845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bb54d-93c0-43e1-a7de-f8ff3de23cca None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:23.337288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bb54d-93c0-43e1-a7de-f8ff3de23cca None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:23.337390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bb54d-93c0-43e1-a7de-f8ff3de23cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:23.356127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-df0bb54d-93c0-43e1-a7de-f8ff3de23cca None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:23.357310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-df0bb54d-93c0-43e1-a7de-f8ff3de23cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:23.366253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 701/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:23.411967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28585734-4740-4995-8344-7dc0cb4d3e5b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:23.428498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28585734-4740-4995-8344-7dc0cb4d3e5b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:23.434030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca52c6-cf09-4ecf-bbb7-4cffa0f51f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:23.434702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca52c6-cf09-4ecf-bbb7-4cffa0f51f56 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:23.434981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca52c6-cf09-4ecf-bbb7-4cffa0f51f56 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:23.435252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca52c6-cf09-4ecf-bbb7-4cffa0f51f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:23.444786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca52c6-cf09-4ecf-bbb7-4cffa0f51f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:23.446362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca52c6-cf09-4ecf-bbb7-4cffa0f51f56 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:23.455931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 687/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:26.734277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ea84-9ae3-4824-9656-08e2aaedfd03 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:26.734896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ea84-9ae3-4824-9656-08e2aaedfd03 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:26.734896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ea84-9ae3-4824-9656-08e2aaedfd03 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:26.737414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 702/1389] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:26.743055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c96d3-26a8-429c-bdbd-3fa3c9787786 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:26.743497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c96d3-26a8-429c-bdbd-3fa3c9787786 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:26.743602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c96d3-26a8-429c-bdbd-3fa3c9787786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:26.761353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-267c96d3-26a8-429c-bdbd-3fa3c9787786 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:26.762545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-267c96d3-26a8-429c-bdbd-3fa3c9787786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:26.770927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 688/1390] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:26.817675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ea84-9ae3-4824-9656-08e2aaedfd03 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:26.831886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ea84-9ae3-4824-9656-08e2aaedfd03 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:26.837360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6725f1-8d34-4ceb-bd12-d6d543114263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:26.837992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6725f1-8d34-4ceb-bd12-d6d543114263 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:26.838269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6725f1-8d34-4ceb-bd12-d6d543114263 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:26.838556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6725f1-8d34-4ceb-bd12-d6d543114263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:26.847341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6725f1-8d34-4ceb-bd12-d6d543114263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:26.848873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6725f1-8d34-4ceb-bd12-d6d543114263 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:26.858273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 703/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:29.450446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f36ef-c4af-40f3-9ae3-0472119e3978 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:29.451082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f36ef-c4af-40f3-9ae3-0472119e3978 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:29.451082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f36ef-c4af-40f3-9ae3-0472119e3978 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:29.452729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 689/1392] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:29.459387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14657d-a5dd-4fee-819e-2bf5c54490b8 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:29.459896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14657d-a5dd-4fee-819e-2bf5c54490b8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:29.460011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14657d-a5dd-4fee-819e-2bf5c54490b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:29.479304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8e14657d-a5dd-4fee-819e-2bf5c54490b8 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:29.480534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8e14657d-a5dd-4fee-819e-2bf5c54490b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:29.488632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 704/1393] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:29.533994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f36ef-c4af-40f3-9ae3-0472119e3978 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:29.548841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f36ef-c4af-40f3-9ae3-0472119e3978 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:29.554889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54587f-9e6d-4823-9642-26c6acf438c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:29.555560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54587f-9e6d-4823-9642-26c6acf438c6 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:29.555844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54587f-9e6d-4823-9642-26c6acf438c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:29.556117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54587f-9e6d-4823-9642-26c6acf438c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:29.565973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54587f-9e6d-4823-9642-26c6acf438c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:29.567653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54587f-9e6d-4823-9642-26c6acf438c6 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:29.577984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 690/1394] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:30.750375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cf917-1509-4009-b8a0-89675527c2d4 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:30.750981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cf917-1509-4009-b8a0-89675527c2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:30.750981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cf917-1509-4009-b8a0-89675527c2d4 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:30.752786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 705/1395] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:30.758770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303875a-69e2-4ae7-b07c-b1b74ced163f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:30.759193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303875a-69e2-4ae7-b07c-b1b74ced163f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:30.759365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303875a-69e2-4ae7-b07c-b1b74ced163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:30.777742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1303875a-69e2-4ae7-b07c-b1b74ced163f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:30.778978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1303875a-69e2-4ae7-b07c-b1b74ced163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:30.786815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 691/1396] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:30.843840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd65c8-4d8c-4d54-aadd-aaa89dff03d4 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:30.844211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd65c8-4d8c-4d54-aadd-aaa89dff03d4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:30.844583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd65c8-4d8c-4d54-aadd-aaa89dff03d4 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:30.847107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 706/1397] 10.222.0.58 () {54 vars in 961 bytes} [Thu Mar 31 18:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:30.852348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ffa0a-4a59-4762-b3ca-c9cfb9e89b63 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:30.852644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ffa0a-4a59-4762-b3ca-c9cfb9e89b63 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:30.852930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ffa0a-4a59-4762-b3ca-c9cfb9e89b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:30.902281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-002ffa0a-4a59-4762-b3ca-c9cfb9e89b63 None None] MFA Rules not processed for user `5bfec7fb739b42bfa2ddd682aa10dc95`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:30.903510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-002ffa0a-4a59-4762-b3ca-c9cfb9e89b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:30.963931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 692/1398] 10.222.0.58 () {58 vars in 1058 bytes} [Thu Mar 31 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:30.971600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd65c8-4d8c-4d54-aadd-aaa89dff03d4 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:30.982058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd65c8-4d8c-4d54-aadd-aaa89dff03d4 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:30.985553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960722-504b-499c-9418-770fbf234dca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bfec7fb739b42bfa2ddd682aa10dc95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:30.986186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960722-504b-499c-9418-770fbf234dca service glance] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:30.987023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960722-504b-499c-9418-770fbf234dca service glance] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:30.987305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960722-504b-499c-9418-770fbf234dca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:30.996052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960722-504b-499c-9418-770fbf234dca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:30.997481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960722-504b-499c-9418-770fbf234dca service glance] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:31.007729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 707/1399] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:06:31.607550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9ede6-3ddd-4604-9987-261406efe067 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:31.607849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9ede6-3ddd-4604-9987-261406efe067 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:31.608133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9ede6-3ddd-4604-9987-261406efe067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:31.656069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-dcf9ede6-3ddd-4604-9987-261406efe067 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:31.657268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dcf9ede6-3ddd-4604-9987-261406efe067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:31.721859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 693/1400] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:31.764966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4fbd-8032-4a4b-81ea-21aa0230d92f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:31.765516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4fbd-8032-4a4b-81ea-21aa0230d92f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:31.765516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f4fbd-8032-4a4b-81ea-21aa0230d92f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:31.768514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 708/1401] 10.222.0.58 () {54 vars in 942 bytes} [Thu Mar 31 18:06:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:31.775698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450fe0-f303-49fe-9798-0d79139fc629 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:31.776251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450fe0-f303-49fe-9798-0d79139fc629 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:31.776340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450fe0-f303-49fe-9798-0d79139fc629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:31.824287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1e450fe0-f303-49fe-9798-0d79139fc629 None None] MFA Rules not processed for user `f3b2e34e638041f7a5338c0d8ae1fa25`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:31.825474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1e450fe0-f303-49fe-9798-0d79139fc629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:31.897153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 694/1402] 10.222.0.58 () {58 vars in 1039 bytes} [Thu Mar 31 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:31.906177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f4fbd-8032-4a4b-81ea-21aa0230d92f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:31.920070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f4fbd-8032-4a4b-81ea-21aa0230d92f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:31.925656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7acde-fe0a-486f-88bd-d32e8b2e6d7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:31.926284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7acde-fe0a-486f-88bd-d32e8b2e6d7f service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:31.926563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7acde-fe0a-486f-88bd-d32e8b2e6d7f service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:31.926863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7acde-fe0a-486f-88bd-d32e8b2e6d7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:31.934829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7acde-fe0a-486f-88bd-d32e8b2e6d7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:31.936379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7acde-fe0a-486f-88bd-d32e8b2e6d7f service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:31.944445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 709/1403] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:06:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:06:32.124822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752142-88e6-447c-a36c-59f1df4abda8 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:32.125103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752142-88e6-447c-a36c-59f1df4abda8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:32.125376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752142-88e6-447c-a36c-59f1df4abda8 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:32.127216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 695/1404] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:32.132667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfccc17-4b12-4beb-8359-a1468324517e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:32.132956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfccc17-4b12-4beb-8359-a1468324517e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:32.133236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfccc17-4b12-4beb-8359-a1468324517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:32.151980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9cfccc17-4b12-4beb-8359-a1468324517e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:32.153108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9cfccc17-4b12-4beb-8359-a1468324517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:32.161355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 710/1405] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:32.208646 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2752142-88e6-447c-a36c-59f1df4abda8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:32.224836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2752142-88e6-447c-a36c-59f1df4abda8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:32.230473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbfbe-b7b0-4c5c-ace4-1682779acfb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:32.231246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbfbe-b7b0-4c5c-ace4-1682779acfb4 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:32.231565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbfbe-b7b0-4c5c-ace4-1682779acfb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:32.231814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbfbe-b7b0-4c5c-ace4-1682779acfb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:32.241090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbfbe-b7b0-4c5c-ace4-1682779acfb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:32.242736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbfbe-b7b0-4c5c-ace4-1682779acfb4 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:32.252454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 696/1406] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:34.811485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9d3ac-ac98-4d5b-81f1-ea633d519575 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:34.812379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9d3ac-ac98-4d5b-81f1-ea633d519575 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:34.812730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9d3ac-ac98-4d5b-81f1-ea633d519575 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:34.814438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 711/1407] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:34.820002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc691-c012-46ac-a527-862cb908d424 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:34.820441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc691-c012-46ac-a527-862cb908d424 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:34.820685 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc691-c012-46ac-a527-862cb908d424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:34.840289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c0ebc691-c012-46ac-a527-862cb908d424 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:34.841606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c0ebc691-c012-46ac-a527-862cb908d424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:34.851250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 697/1408] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:34.896983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9d3ac-ac98-4d5b-81f1-ea633d519575 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:34.913537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9d3ac-ac98-4d5b-81f1-ea633d519575 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:34.919709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8adaa-2021-4c63-9a16-cee103e7f456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:34.920554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8adaa-2021-4c63-9a16-cee103e7f456 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:34.920838 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8adaa-2021-4c63-9a16-cee103e7f456 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:34.921114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8adaa-2021-4c63-9a16-cee103e7f456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:34.930798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8adaa-2021-4c63-9a16-cee103e7f456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:34.932212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8adaa-2021-4c63-9a16-cee103e7f456 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:34.941878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 712/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:06:56.386364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30ba9d-9f71-48ba-951f-ad3c78c3cbea None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:56.387076 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30ba9d-9f71-48ba-951f-ad3c78c3cbea None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:56.387076 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30ba9d-9f71-48ba-951f-ad3c78c3cbea None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:56.388621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 698/1410] 10.222.0.58 () {54 vars in 918 bytes} [Thu Mar 31 18:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:56.394839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c264fc5-e42c-4b23-9a40-de171d5900fe None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:56.395315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c264fc5-e42c-4b23-9a40-de171d5900fe None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:56.395429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c264fc5-e42c-4b23-9a40-de171d5900fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:56.414184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0c264fc5-e42c-4b23-9a40-de171d5900fe None None] MFA Rules not processed for user `511e982844c347c8bd49f51aaf29be71`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:56.415588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0c264fc5-e42c-4b23-9a40-de171d5900fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:56.423816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 713/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Mar 31 18:06:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:56.437896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ac831-e86a-4528-ad48-292cce25bf03 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:56.438182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ac831-e86a-4528-ad48-292cce25bf03 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:56.438460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ac831-e86a-4528-ad48-292cce25bf03 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:56.440292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 699/1412] 10.222.0.58 () {54 vars in 918 bytes} [Thu Mar 31 18:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:56.444757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658325b-b20d-4d74-ab6c-6b99ea72c983 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:56.445047 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658325b-b20d-4d74-ab6c-6b99ea72c983 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:56.445327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658325b-b20d-4d74-ab6c-6b99ea72c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:56.463361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d658325b-b20d-4d74-ab6c-6b99ea72c983 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:56.464529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d658325b-b20d-4d74-ab6c-6b99ea72c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:56.474343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 714/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Mar 31 18:06:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:59.233499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2fc8-05c2-4c57-a4eb-82fb42d60c69 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:59.234027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2fc8-05c2-4c57-a4eb-82fb42d60c69 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:59.234027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2fc8-05c2-4c57-a4eb-82fb42d60c69 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:59.235841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:06:59.241781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d835-9f6d-45b2-af16-bbcc2766f6b5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:59.242199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d835-9f6d-45b2-af16-bbcc2766f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:59.242334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d835-9f6d-45b2-af16-bbcc2766f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:59.261075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4941d835-9f6d-45b2-af16-bbcc2766f6b5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:06:59.262245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4941d835-9f6d-45b2-af16-bbcc2766f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:06:59.270351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:06:59.311444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd2fc8-05c2-4c57-a4eb-82fb42d60c69 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:06:59.325782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd2fc8-05c2-4c57-a4eb-82fb42d60c69 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:06:59.331034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30244f8c-2e0c-4d00-9222-7ab7bbd0bd35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:06:59.331661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244f8c-2e0c-4d00-9222-7ab7bbd0bd35 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:06:59.331937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244f8c-2e0c-4d00-9222-7ab7bbd0bd35 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:06:59.332210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244f8c-2e0c-4d00-9222-7ab7bbd0bd35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:06:59.340156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30244f8c-2e0c-4d00-9222-7ab7bbd0bd35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:06:59.341710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30244f8c-2e0c-4d00-9222-7ab7bbd0bd35 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:06:59.350783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 701/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:00.718621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0404d0-4efc-4f92-807d-1306ec56757f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:00.719166 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0404d0-4efc-4f92-807d-1306ec56757f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:00.719273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0404d0-4efc-4f92-807d-1306ec56757f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:00.721092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:00.726300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefda74b-0983-4d40-bdf2-30386271568c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:00.726844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefda74b-0983-4d40-bdf2-30386271568c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:00.726958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefda74b-0983-4d40-bdf2-30386271568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:00.747593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-eefda74b-0983-4d40-bdf2-30386271568c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:00.748774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-eefda74b-0983-4d40-bdf2-30386271568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:00.757266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:00.915434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0404d0-4efc-4f92-807d-1306ec56757f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:00.930092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0404d0-4efc-4f92-807d-1306ec56757f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:00.935471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4427a-a40e-4ed2-91a6-ef5f65246909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:00.936099 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4427a-a40e-4ed2-91a6-ef5f65246909 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:00.936376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4427a-a40e-4ed2-91a6-ef5f65246909 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:00.936645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4427a-a40e-4ed2-91a6-ef5f65246909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:00.945496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4427a-a40e-4ed2-91a6-ef5f65246909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:00.947094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4427a-a40e-4ed2-91a6-ef5f65246909 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:00.956488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 717/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:02.284120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e04a-8558-4f72-8b30-5996a7e545c5 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:02.284894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e04a-8558-4f72-8b30-5996a7e545c5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:02.284894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e04a-8558-4f72-8b30-5996a7e545c5 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:02.287207 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:02.292245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e81b11-3dec-4283-875a-66d4c9f91d7b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:02.292662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e81b11-3dec-4283-875a-66d4c9f91d7b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:02.292797 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e81b11-3dec-4283-875a-66d4c9f91d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:02.310598 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b1e81b11-3dec-4283-875a-66d4c9f91d7b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:02.311730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b1e81b11-3dec-4283-875a-66d4c9f91d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:02.319333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:02.470990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e04a-8558-4f72-8b30-5996a7e545c5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:02.485606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e04a-8558-4f72-8b30-5996a7e545c5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:02.491186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ffe13-ba0e-40db-b97e-45cf8e511cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:02.491819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ffe13-ba0e-40db-b97e-45cf8e511cc1 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:02.492103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ffe13-ba0e-40db-b97e-45cf8e511cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:02.492379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ffe13-ba0e-40db-b97e-45cf8e511cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:02.500272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ffe13-ba0e-40db-b97e-45cf8e511cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:02.501830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ffe13-ba0e-40db-b97e-45cf8e511cc1 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:02.511513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 704/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:03.808416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf96b0-d57f-421c-a252-6b10eae09978 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:03.808982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf96b0-d57f-421c-a252-6b10eae09978 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:03.808982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf96b0-d57f-421c-a252-6b10eae09978 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:03.810848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:03.816465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ef1b-e97c-4be3-8d7c-6bb258823215 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:03.816920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ef1b-e97c-4be3-8d7c-6bb258823215 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:03.817201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ef1b-e97c-4be3-8d7c-6bb258823215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:03.835114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f953ef1b-e97c-4be3-8d7c-6bb258823215 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:03.836415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f953ef1b-e97c-4be3-8d7c-6bb258823215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:03.844251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:03.994511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf96b0-d57f-421c-a252-6b10eae09978 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:04.009342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf96b0-d57f-421c-a252-6b10eae09978 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:04.014778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d0cba-ed56-444a-afbb-ffa93a18cbd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:04.015414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d0cba-ed56-444a-afbb-ffa93a18cbd5 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:04.015694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d0cba-ed56-444a-afbb-ffa93a18cbd5 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:04.015971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d0cba-ed56-444a-afbb-ffa93a18cbd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:04.024455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d0cba-ed56-444a-afbb-ffa93a18cbd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:04.026019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d0cba-ed56-444a-afbb-ffa93a18cbd5 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:04.036363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 720/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:05.346284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33eca6-0d5a-41c5-9ffc-79920f1e2cb7 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:05.346932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33eca6-0d5a-41c5-9ffc-79920f1e2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:05.346932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33eca6-0d5a-41c5-9ffc-79920f1e2cb7 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:05.348701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:05.353602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d858-1b81-4a09-a33a-fc91255b9ec3 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:05.354044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d858-1b81-4a09-a33a-fc91255b9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:05.354151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d858-1b81-4a09-a33a-fc91255b9ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:05.372499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2c88d858-1b81-4a09-a33a-fc91255b9ec3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:05.373674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2c88d858-1b81-4a09-a33a-fc91255b9ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:05.382008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:05.532945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33eca6-0d5a-41c5-9ffc-79920f1e2cb7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:05.547396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33eca6-0d5a-41c5-9ffc-79920f1e2cb7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:05.553339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128273-2685-42cf-b712-a9f290970459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:05.553967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128273-2685-42cf-b712-a9f290970459 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:05.554251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128273-2685-42cf-b712-a9f290970459 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:05.554518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128273-2685-42cf-b712-a9f290970459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:05.562323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79128273-2685-42cf-b712-a9f290970459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:05.563952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79128273-2685-42cf-b712-a9f290970459 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:05.573166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 707/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:06.878715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab806e4-ee32-4c78-bcfd-aaa73e0101d7 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:06.879295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab806e4-ee32-4c78-bcfd-aaa73e0101d7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:06.879295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab806e4-ee32-4c78-bcfd-aaa73e0101d7 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:06.881051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:06.885998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fe662-30c3-4a50-9708-26e1864d6a33 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:06.886404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fe662-30c3-4a50-9708-26e1864d6a33 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:06.886563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fe662-30c3-4a50-9708-26e1864d6a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:06.904993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ce5fe662-30c3-4a50-9708-26e1864d6a33 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:06.906196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ce5fe662-30c3-4a50-9708-26e1864d6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:06.914666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:07:07.064936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab806e4-ee32-4c78-bcfd-aaa73e0101d7 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:07.079558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab806e4-ee32-4c78-bcfd-aaa73e0101d7 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:07.085800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b295c-c5ae-4407-b905-8e8164260277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:07.086432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b295c-c5ae-4407-b905-8e8164260277 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:07.086750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b295c-c5ae-4407-b905-8e8164260277 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:07.087025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b295c-c5ae-4407-b905-8e8164260277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:07.095256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b295c-c5ae-4407-b905-8e8164260277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:07.096912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b295c-c5ae-4407-b905-8e8164260277 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:07.106008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 723/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:08.416437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8502-e246-42e2-9de0-eef83e855dbf None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:08.416954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8502-e246-42e2-9de0-eef83e855dbf None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:08.416954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8502-e246-42e2-9de0-eef83e855dbf None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:08.418701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:08.423705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523b1f-5380-4d05-a9e3-ba4b7693b756 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:08.424093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523b1f-5380-4d05-a9e3-ba4b7693b756 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:08.424259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523b1f-5380-4d05-a9e3-ba4b7693b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:08.442749 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-45523b1f-5380-4d05-a9e3-ba4b7693b756 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:08.443935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-45523b1f-5380-4d05-a9e3-ba4b7693b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:08.451616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:08.605204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8502-e246-42e2-9de0-eef83e855dbf None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:08.620635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8502-e246-42e2-9de0-eef83e855dbf None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:08.625909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab105-a0c2-4adb-aa8f-ed710b4b4dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:08.626532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab105-a0c2-4adb-aa8f-ed710b4b4dce service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:08.626860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab105-a0c2-4adb-aa8f-ed710b4b4dce service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:08.627137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab105-a0c2-4adb-aa8f-ed710b4b4dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:08.635660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab105-a0c2-4adb-aa8f-ed710b4b4dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:08.637211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab105-a0c2-4adb-aa8f-ed710b4b4dce service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:08.647712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 710/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:09.975330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f996d7-3ce0-4bac-a86b-51737ce6bec3 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:09.975847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f996d7-3ce0-4bac-a86b-51737ce6bec3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:09.975959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f996d7-3ce0-4bac-a86b-51737ce6bec3 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:09.977638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:09.982585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7a516-92ac-4009-b3a2-88ebaa1e626f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:09.983111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7a516-92ac-4009-b3a2-88ebaa1e626f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:09.983206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7a516-92ac-4009-b3a2-88ebaa1e626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:10.000926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ade7a516-92ac-4009-b3a2-88ebaa1e626f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:10.002114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ade7a516-92ac-4009-b3a2-88ebaa1e626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:10.010577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:10.230041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f996d7-3ce0-4bac-a86b-51737ce6bec3 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:10.230041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f996d7-3ce0-4bac-a86b-51737ce6bec3 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:10.230041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e278af-8570-44b1-9ce1-e61055939bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:10.230041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e278af-8570-44b1-9ce1-e61055939bae service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:10.231070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e278af-8570-44b1-9ce1-e61055939bae service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:10.231070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e278af-8570-44b1-9ce1-e61055939bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:10.231070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e278af-8570-44b1-9ce1-e61055939bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:10.231070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e278af-8570-44b1-9ce1-e61055939bae service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:10.231070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 726/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:11.576103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4092-0201-43b9-ba50-03988278bfcd None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:11.576676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4092-0201-43b9-ba50-03988278bfcd None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:11.576676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4092-0201-43b9-ba50-03988278bfcd None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:11.578422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:11.583688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f20b8d-0178-4032-b3ec-cffa053ada2c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:11.584122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f20b8d-0178-4032-b3ec-cffa053ada2c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:11.584270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f20b8d-0178-4032-b3ec-cffa053ada2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:11.603268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-87f20b8d-0178-4032-b3ec-cffa053ada2c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:11.604450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-87f20b8d-0178-4032-b3ec-cffa053ada2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:11.612206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:11.763178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4092-0201-43b9-ba50-03988278bfcd None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:11.777989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4092-0201-43b9-ba50-03988278bfcd None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:11.783300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa244e-5df0-42b9-9d15-4f28103fd915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:11.783971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa244e-5df0-42b9-9d15-4f28103fd915 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:11.784251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa244e-5df0-42b9-9d15-4f28103fd915 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:11.785060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa244e-5df0-42b9-9d15-4f28103fd915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:11.793281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa244e-5df0-42b9-9d15-4f28103fd915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:11.794873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa244e-5df0-42b9-9d15-4f28103fd915 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:11.804795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 713/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:13.983824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d2c3-4853-4186-88ce-19ae6d35668c None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:13.984399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d2c3-4853-4186-88ce-19ae6d35668c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:13.984399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d2c3-4853-4186-88ce-19ae6d35668c None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:13.986221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:13.991851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925f01-b045-4378-b90a-45dd28f3422e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:13.992293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925f01-b045-4378-b90a-45dd28f3422e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:13.992390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925f01-b045-4378-b90a-45dd28f3422e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:14.010131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-dd925f01-b045-4378-b90a-45dd28f3422e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:14.011339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dd925f01-b045-4378-b90a-45dd28f3422e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:14.019149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:14.058031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d2c3-4853-4186-88ce-19ae6d35668c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:14.069045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d2c3-4853-4186-88ce-19ae6d35668c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:14.072772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d85b8-0906-480e-8547-7a6eddd4a36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:14.073412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d85b8-0906-480e-8547-7a6eddd4a36b service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:14.073692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d85b8-0906-480e-8547-7a6eddd4a36b service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:14.073994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d85b8-0906-480e-8547-7a6eddd4a36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:14.083669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d85b8-0906-480e-8547-7a6eddd4a36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:14.085103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d85b8-0906-480e-8547-7a6eddd4a36b service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:14.094362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 729/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:16.533331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce322-f626-4621-9086-b8cf44983c5b None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:16.533922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce322-f626-4621-9086-b8cf44983c5b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:16.533922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce322-f626-4621-9086-b8cf44983c5b None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:16.536245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:16.541591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652432f-dbe4-4b57-9954-37a664c16a17 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:16.542003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652432f-dbe4-4b57-9954-37a664c16a17 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:16.542178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652432f-dbe4-4b57-9954-37a664c16a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:16.559741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7652432f-dbe4-4b57-9954-37a664c16a17 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:16.560930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7652432f-dbe4-4b57-9954-37a664c16a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:16.568824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:16.608048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce322-f626-4621-9086-b8cf44983c5b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:16.619007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce322-f626-4621-9086-b8cf44983c5b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:16.622527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80f0e8-ccd3-4ced-92d4-9f2d8b551eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:16.623266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f0e8-ccd3-4ced-92d4-9f2d8b551eed service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:16.623574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f0e8-ccd3-4ced-92d4-9f2d8b551eed service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:16.623855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f0e8-ccd3-4ced-92d4-9f2d8b551eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:16.633147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80f0e8-ccd3-4ced-92d4-9f2d8b551eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:16.634563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80f0e8-ccd3-4ced-92d4-9f2d8b551eed service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:16.644524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 716/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:19.329079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72fe20-86e7-4dac-ae38-682224b8557a None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:19.329600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72fe20-86e7-4dac-ae38-682224b8557a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:19.329600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72fe20-86e7-4dac-ae38-682224b8557a None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:19.331384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:19.336764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001acb4a-124e-45ab-8ed0-f350a7b48958 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:19.337176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001acb4a-124e-45ab-8ed0-f350a7b48958 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:19.337319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001acb4a-124e-45ab-8ed0-f350a7b48958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:19.355419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-001acb4a-124e-45ab-8ed0-f350a7b48958 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:19.356599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-001acb4a-124e-45ab-8ed0-f350a7b48958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:19.365017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:19.403163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72fe20-86e7-4dac-ae38-682224b8557a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:19.414188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72fe20-86e7-4dac-ae38-682224b8557a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:19.417696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530eb0c4-018b-4ddf-bd50-e8a823ddf690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:19.418320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530eb0c4-018b-4ddf-bd50-e8a823ddf690 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:19.418601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530eb0c4-018b-4ddf-bd50-e8a823ddf690 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:19.418912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530eb0c4-018b-4ddf-bd50-e8a823ddf690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:19.427700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530eb0c4-018b-4ddf-bd50-e8a823ddf690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:19.429106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530eb0c4-018b-4ddf-bd50-e8a823ddf690 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:19.438197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 732/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:21.839348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061d1d-e0c2-4a20-b576-00c9eb99c76a None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:21.839916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061d1d-e0c2-4a20-b576-00c9eb99c76a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:21.839916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061d1d-e0c2-4a20-b576-00c9eb99c76a None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:21.841699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:21.846841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e59e3-aaea-4a8d-932d-3711a61e801e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:21.847273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e59e3-aaea-4a8d-932d-3711a61e801e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:21.848064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e59e3-aaea-4a8d-932d-3711a61e801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:21.865381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-991e59e3-aaea-4a8d-932d-3711a61e801e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:21.866561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-991e59e3-aaea-4a8d-932d-3711a61e801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:21.874255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:21.913242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061d1d-e0c2-4a20-b576-00c9eb99c76a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:21.924563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061d1d-e0c2-4a20-b576-00c9eb99c76a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:21.928058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847a0b1-d832-4038-bb03-b93fecb54046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:21.928686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a0b1-d832-4038-bb03-b93fecb54046 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:21.929014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a0b1-d832-4038-bb03-b93fecb54046 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:21.929289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a0b1-d832-4038-bb03-b93fecb54046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:21.937863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847a0b1-d832-4038-bb03-b93fecb54046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:21.939315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847a0b1-d832-4038-bb03-b93fecb54046 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:21.948513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 719/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:24.389494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e916-d3e1-47d1-9aa2-955c3e6f070c None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:24.390009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e916-d3e1-47d1-9aa2-955c3e6f070c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:24.390009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e916-d3e1-47d1-9aa2-955c3e6f070c None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:24.391785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:24.397789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba63f3-ddea-4c5f-aa55-04bbe07bb0f7 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:24.398235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba63f3-ddea-4c5f-aa55-04bbe07bb0f7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:24.398331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba63f3-ddea-4c5f-aa55-04bbe07bb0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:24.415847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-20ba63f3-ddea-4c5f-aa55-04bbe07bb0f7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:24.417027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-20ba63f3-ddea-4c5f-aa55-04bbe07bb0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:24.424708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:24.462980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e916-d3e1-47d1-9aa2-955c3e6f070c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:24.473604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e916-d3e1-47d1-9aa2-955c3e6f070c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:24.477403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df784a6-68c6-434b-a00b-9cad107ca327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:24.478034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df784a6-68c6-434b-a00b-9cad107ca327 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:24.478315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df784a6-68c6-434b-a00b-9cad107ca327 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:24.478589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df784a6-68c6-434b-a00b-9cad107ca327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:24.487343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df784a6-68c6-434b-a00b-9cad107ca327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:24.488902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df784a6-68c6-434b-a00b-9cad107ca327 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:24.498089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 735/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:26.841802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0be3-a7bb-4fd2-8551-438b9b53a111 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:26.842369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0be3-a7bb-4fd2-8551-438b9b53a111 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:26.842369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0be3-a7bb-4fd2-8551-438b9b53a111 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:26.844188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:26.849721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada26679-e2c2-4153-b709-e84cad11aeda None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:26.850172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada26679-e2c2-4153-b709-e84cad11aeda None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:26.850279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada26679-e2c2-4153-b709-e84cad11aeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:26.868281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ada26679-e2c2-4153-b709-e84cad11aeda None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:26.869481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ada26679-e2c2-4153-b709-e84cad11aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:26.877219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:26.915615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d0be3-a7bb-4fd2-8551-438b9b53a111 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:26.927489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d0be3-a7bb-4fd2-8551-438b9b53a111 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:26.931038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363149fa-a1bd-432c-bd7c-36843dd326d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:26.931684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363149fa-a1bd-432c-bd7c-36843dd326d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:26.931964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363149fa-a1bd-432c-bd7c-36843dd326d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:26.938142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363149fa-a1bd-432c-bd7c-36843dd326d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:26.942275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363149fa-a1bd-432c-bd7c-36843dd326d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:26.943751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363149fa-a1bd-432c-bd7c-36843dd326d0 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:26.953505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 722/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:29.400236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b395d9-1d5f-4da8-8fea-da48bfa6211b None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:29.400763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b395d9-1d5f-4da8-8fea-da48bfa6211b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:29.400763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b395d9-1d5f-4da8-8fea-da48bfa6211b None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:29.402550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:29.407910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73222a7-3dda-4dfe-8a29-99b8dc993d64 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:29.408343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73222a7-3dda-4dfe-8a29-99b8dc993d64 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:29.408464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73222a7-3dda-4dfe-8a29-99b8dc993d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:29.427393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c73222a7-3dda-4dfe-8a29-99b8dc993d64 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:29.428607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c73222a7-3dda-4dfe-8a29-99b8dc993d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:29.436558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:29.474917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b395d9-1d5f-4da8-8fea-da48bfa6211b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:29.485452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b395d9-1d5f-4da8-8fea-da48bfa6211b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:29.489651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b3b19-4143-4f6b-9533-abafacf2dc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:29.490277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3b19-4143-4f6b-9533-abafacf2dc66 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:29.490554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3b19-4143-4f6b-9533-abafacf2dc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:29.490857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b3b19-4143-4f6b-9533-abafacf2dc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:29.499540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3b19-4143-4f6b-9533-abafacf2dc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:29.500947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b3b19-4143-4f6b-9533-abafacf2dc66 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:29.511143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 738/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:31.843101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b000ae-9309-49d8-8372-9f29e2f4f85e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:31.843660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b000ae-9309-49d8-8372-9f29e2f4f85e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:31.843660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b000ae-9309-49d8-8372-9f29e2f4f85e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:31.845424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:31.850826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f526-e374-4e57-9931-b9f9b5212244 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:31.851334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f526-e374-4e57-9931-b9f9b5212244 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:31.851431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f526-e374-4e57-9931-b9f9b5212244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:31.868550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-90c5f526-e374-4e57-9931-b9f9b5212244 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:31.869714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-90c5f526-e374-4e57-9931-b9f9b5212244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:31.877289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:31.915098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b000ae-9309-49d8-8372-9f29e2f4f85e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:31.925537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b000ae-9309-49d8-8372-9f29e2f4f85e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:31.929183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca3906-3ed7-4c72-83af-dd3a576e819d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:31.929819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3906-3ed7-4c72-83af-dd3a576e819d service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:31.930103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3906-3ed7-4c72-83af-dd3a576e819d service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:31.930381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3906-3ed7-4c72-83af-dd3a576e819d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:31.939147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca3906-3ed7-4c72-83af-dd3a576e819d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:31.940578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca3906-3ed7-4c72-83af-dd3a576e819d service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:31.950465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 725/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:34.264964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eba89-fa8c-48ed-bce2-0e2f443d20db None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:34.265519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eba89-fa8c-48ed-bce2-0e2f443d20db None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:34.265519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eba89-fa8c-48ed-bce2-0e2f443d20db None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:34.267343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:34.273569 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6725daa-595b-4cfd-ae9d-bb833cb06cd2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:34.274014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6725daa-595b-4cfd-ae9d-bb833cb06cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:34.274121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6725daa-595b-4cfd-ae9d-bb833cb06cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:34.292128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a6725daa-595b-4cfd-ae9d-bb833cb06cd2 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:34.293361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a6725daa-595b-4cfd-ae9d-bb833cb06cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:34.301708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:34.341207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eba89-fa8c-48ed-bce2-0e2f443d20db None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:34.351864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eba89-fa8c-48ed-bce2-0e2f443d20db None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:34.355329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee966f-372a-4155-93bb-aaa5c2c1ed3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:34.355957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee966f-372a-4155-93bb-aaa5c2c1ed3d service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:34.356237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee966f-372a-4155-93bb-aaa5c2c1ed3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:34.356511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee966f-372a-4155-93bb-aaa5c2c1ed3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:34.366007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee966f-372a-4155-93bb-aaa5c2c1ed3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:34.367591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee966f-372a-4155-93bb-aaa5c2c1ed3d service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:34.376805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 741/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:36.688229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e63c2-0a3f-4373-939d-f0b2b3c08f1f None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:36.688767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e63c2-0a3f-4373-939d-f0b2b3c08f1f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:36.688886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e63c2-0a3f-4373-939d-f0b2b3c08f1f None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:36.690689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:36.696044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1235-b379-45c1-b9c2-e693fdb1dba6 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:36.696430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1235-b379-45c1-b9c2-e693fdb1dba6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:36.696595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1235-b379-45c1-b9c2-e693fdb1dba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:36.714378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-bd9c1235-b379-45c1-b9c2-e693fdb1dba6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:36.715613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bd9c1235-b379-45c1-b9c2-e693fdb1dba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:36.723961 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:36.760137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e63c2-0a3f-4373-939d-f0b2b3c08f1f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:36.771561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e63c2-0a3f-4373-939d-f0b2b3c08f1f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:36.775089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe188f7-c56a-44e4-8c03-94ccbc9bcb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:36.775744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe188f7-c56a-44e4-8c03-94ccbc9bcb7a service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:36.776023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe188f7-c56a-44e4-8c03-94ccbc9bcb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:36.776302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe188f7-c56a-44e4-8c03-94ccbc9bcb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:36.785053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe188f7-c56a-44e4-8c03-94ccbc9bcb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:36.787150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe188f7-c56a-44e4-8c03-94ccbc9bcb7a service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:36.796424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 728/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:57.550028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf27b-d5cf-46e0-97e2-98ae80fe1db2 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:57.550664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf27b-d5cf-46e0-97e2-98ae80fe1db2 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:57.550664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf27b-d5cf-46e0-97e2-98ae80fe1db2 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:57.553125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 743/1471] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:57.558245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41142db1-d8c7-4c3e-acd7-1e3815d8f0ef None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:57.558709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41142db1-d8c7-4c3e-acd7-1e3815d8f0ef None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:57.558815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41142db1-d8c7-4c3e-acd7-1e3815d8f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:57.576212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-41142db1-d8c7-4c3e-acd7-1e3815d8f0ef None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:57.577389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-41142db1-d8c7-4c3e-acd7-1e3815d8f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:57.585271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 729/1472] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:57.632258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee8c0e-28ae-4bc5-8deb-17aaa312a00e None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:57.632544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee8c0e-28ae-4bc5-8deb-17aaa312a00e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:57.632823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee8c0e-28ae-4bc5-8deb-17aaa312a00e None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:57.634663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 744/1473] 10.222.0.58 () {54 vars in 961 bytes} [Thu Mar 31 18:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:07:57.639336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067c0c-15bc-43b8-bd49-956986fd0185 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:57.644877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067c0c-15bc-43b8-bd49-956986fd0185 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:57.644877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067c0c-15bc-43b8-bd49-956986fd0185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:57.659526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4e067c0c-15bc-43b8-bd49-956986fd0185 None None] MFA Rules not processed for user `5bfec7fb739b42bfa2ddd682aa10dc95`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:07:57.660703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4e067c0c-15bc-43b8-bd49-956986fd0185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:07:57.667691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 730/1474] 10.222.0.58 () {58 vars in 1058 bytes} [Thu Mar 31 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:07:57.674787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee8c0e-28ae-4bc5-8deb-17aaa312a00e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:07:57.685229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee8c0e-28ae-4bc5-8deb-17aaa312a00e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:07:57.688741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082216-0441-42cb-a707-9d17f10d7698 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bfec7fb739b42bfa2ddd682aa10dc95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:07:57.689364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082216-0441-42cb-a707-9d17f10d7698 service glance] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:07:57.689644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082216-0441-42cb-a707-9d17f10d7698 service glance] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:07:57.689919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082216-0441-42cb-a707-9d17f10d7698 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:07:57.700181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082216-0441-42cb-a707-9d17f10d7698 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:07:57.701607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082216-0441-42cb-a707-9d17f10d7698 service glance] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:07:57.711282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 745/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:08:00.074964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3eb6-e5e7-41e6-a5fa-801927df0a22 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:00.075462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3eb6-e5e7-41e6-a5fa-801927df0a22 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:00.075565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3eb6-e5e7-41e6-a5fa-801927df0a22 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:00.077304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 731/1476] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:08:00.082514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ea08-e9cd-4a3c-a984-75b5ffcbaee2 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:00.082986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ea08-e9cd-4a3c-a984-75b5ffcbaee2 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:00.083136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ea08-e9cd-4a3c-a984-75b5ffcbaee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:00.100481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0ae1ea08-e9cd-4a3c-a984-75b5ffcbaee2 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:08:00.101654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0ae1ea08-e9cd-4a3c-a984-75b5ffcbaee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:08:00.109426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 746/1477] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:08:00.133198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3eb6-e5e7-41e6-a5fa-801927df0a22 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:08:00.145316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3eb6-e5e7-41e6-a5fa-801927df0a22 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:08:00.150166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502fb5d-9960-402f-bc1b-7729b1d4dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:08:00.150837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502fb5d-9960-402f-bc1b-7729b1d4dd66 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:00.151119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502fb5d-9960-402f-bc1b-7729b1d4dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:00.151391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502fb5d-9960-402f-bc1b-7729b1d4dd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:00.152116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502fb5d-9960-402f-bc1b-7729b1d4dd66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:08:00.153811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-0502fb5d-9960-402f-bc1b-7729b1d4dd66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:08:00.153811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:08:00.153811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:08:00.154971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502fb5d-9960-402f-bc1b-7729b1d4dd66 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:08:00.173590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 732/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Mar 31 18:08:00 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:08:02.494348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeece23-8ed0-4de4-9192-c18fc14d08ae None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:02.494919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeece23-8ed0-4de4-9192-c18fc14d08ae None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:02.494919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeece23-8ed0-4de4-9192-c18fc14d08ae None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:02.496684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 747/1479] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:08:02.501811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dc5d8-960c-423c-91bd-6df7e3b48bf6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:02.502273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dc5d8-960c-423c-91bd-6df7e3b48bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:02.502376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dc5d8-960c-423c-91bd-6df7e3b48bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:02.520514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-598dc5d8-960c-423c-91bd-6df7e3b48bf6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:08:02.523215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-598dc5d8-960c-423c-91bd-6df7e3b48bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:08:02.530989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 733/1480] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:08:02.573551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeece23-8ed0-4de4-9192-c18fc14d08ae None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:08:02.588118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeece23-8ed0-4de4-9192-c18fc14d08ae None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:08:02.593576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee41b82-8e14-4ba6-afab-4889a8c611cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:08:02.594202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41b82-8e14-4ba6-afab-4889a8c611cf service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:02.594483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41b82-8e14-4ba6-afab-4889a8c611cf service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:02.594784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41b82-8e14-4ba6-afab-4889a8c611cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:02.602706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee41b82-8e14-4ba6-afab-4889a8c611cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:08:02.610377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee41b82-8e14-4ba6-afab-4889a8c611cf service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:08:02.613338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 748/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:08:05.085261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac1975-27e5-4172-ab72-736540398ea6 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:05.085755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac1975-27e5-4172-ab72-736540398ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:05.085879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac1975-27e5-4172-ab72-736540398ea6 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:05.087617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 734/1482] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:08:05.092786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f5ff-3163-4390-a246-4d0402d5cdc5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:05.093164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f5ff-3163-4390-a246-4d0402d5cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:05.093342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f5ff-3163-4390-a246-4d0402d5cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:05.111035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4d63f5ff-3163-4390-a246-4d0402d5cdc5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:08:05.112279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4d63f5ff-3163-4390-a246-4d0402d5cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:08:05.120929 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 749/1483] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:08:05.157422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac1975-27e5-4172-ab72-736540398ea6 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:08:05.167794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac1975-27e5-4172-ab72-736540398ea6 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:08:05.171234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd5b1-e6e4-4658-8e63-a3848f481903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:08:05.171859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd5b1-e6e4-4658-8e63-a3848f481903 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:05.172136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd5b1-e6e4-4658-8e63-a3848f481903 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:05.172411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd5b1-e6e4-4658-8e63-a3848f481903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:05.181640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bd5b1-e6e4-4658-8e63-a3848f481903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:08:05.183365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bd5b1-e6e4-4658-8e63-a3848f481903 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:08:05.192362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 735/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:08:07.566129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2128e-7651-44e7-a2ba-5663abbcedbe None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:07.566682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2128e-7651-44e7-a2ba-5663abbcedbe None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:07.566800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2128e-7651-44e7-a2ba-5663abbcedbe None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:07.568623 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 750/1485] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:08:07.573804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f948f4-9254-4abd-b84e-72464cb4e27f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:07.574242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f948f4-9254-4abd-b84e-72464cb4e27f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:07.574360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f948f4-9254-4abd-b84e-72464cb4e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:07.592359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b9f948f4-9254-4abd-b84e-72464cb4e27f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:08:07.593528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b9f948f4-9254-4abd-b84e-72464cb4e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:08:07.602367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 736/1486] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:08:07.640233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2128e-7651-44e7-a2ba-5663abbcedbe None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:08:07.651544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2128e-7651-44e7-a2ba-5663abbcedbe None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:08:07.655125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdff24-2c66-4c2d-8a72-0fd9b03669a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:08:07.655757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdff24-2c66-4c2d-8a72-0fd9b03669a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:07.656038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdff24-2c66-4c2d-8a72-0fd9b03669a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:07.656314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdff24-2c66-4c2d-8a72-0fd9b03669a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:07.665822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdff24-2c66-4c2d-8a72-0fd9b03669a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:08:07.667375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdff24-2c66-4c2d-8a72-0fd9b03669a0 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:08:07.676537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 751/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:08:10.065598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a271-8491-4672-9342-5ff0b6943c83 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:10.066090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a271-8491-4672-9342-5ff0b6943c83 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:10.066196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a271-8491-4672-9342-5ff0b6943c83 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:10.068536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 737/1488] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:08:10.073741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d1b7-ff0e-4e4b-aa70-4bc367225463 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:10.074155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d1b7-ff0e-4e4b-aa70-4bc367225463 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:10.074295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d1b7-ff0e-4e4b-aa70-4bc367225463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:10.093027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-6be3d1b7-ff0e-4e4b-aa70-4bc367225463 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:08:10.094197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6be3d1b7-ff0e-4e4b-aa70-4bc367225463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:08:10.101832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 752/1489] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:08:10.141694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374a271-8491-4672-9342-5ff0b6943c83 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:08:10.153379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374a271-8491-4672-9342-5ff0b6943c83 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:08:10.156827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de423925-30ef-4f5c-8ce5-a938f244a299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:08:10.157454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423925-30ef-4f5c-8ce5-a938f244a299 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:10.157732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423925-30ef-4f5c-8ce5-a938f244a299 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:10.158002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423925-30ef-4f5c-8ce5-a938f244a299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:10.166746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de423925-30ef-4f5c-8ce5-a938f244a299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:08:10.168133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de423925-30ef-4f5c-8ce5-a938f244a299 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:08:10.177209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 738/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:08:12.880334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2178-d8dd-4121-8ffe-09ad19161e0a None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:12.881003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2178-d8dd-4121-8ffe-09ad19161e0a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:12.881003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2178-d8dd-4121-8ffe-09ad19161e0a None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:12.882692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 753/1491] 10.222.0.58 () {54 vars in 926 bytes} [Thu Mar 31 18:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:08:12.888285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924914-62a9-4916-84f3-b7a9e96d6c55 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:12.888696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924914-62a9-4916-84f3-b7a9e96d6c55 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:12.888830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924914-62a9-4916-84f3-b7a9e96d6c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:12.913681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-11924914-62a9-4916-84f3-b7a9e96d6c55 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:08:12.915112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-11924914-62a9-4916-84f3-b7a9e96d6c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:08:12.923639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 739/1492] 10.222.0.58 () {58 vars in 1023 bytes} [Thu Mar 31 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:08:12.963450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2178-d8dd-4121-8ffe-09ad19161e0a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:08:12.975396 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2178-d8dd-4121-8ffe-09ad19161e0a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:08:12.978928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e639b1-06e0-4816-9c6b-14081023093d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:08:12.979570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e639b1-06e0-4816-9c6b-14081023093d service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:08:12.980548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e639b1-06e0-4816-9c6b-14081023093d service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:08:12.980862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e639b1-06e0-4816-9c6b-14081023093d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:08:12.990779 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e639b1-06e0-4816-9c6b-14081023093d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:08:12.992537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e639b1-06e0-4816-9c6b-14081023093d service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:08:13.002654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 754/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:09:43.283178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1057ec-e223-4995-b201-55b888ee5ff6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.283767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1057ec-e223-4995-b201-55b888ee5ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.283767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1057ec-e223-4995-b201-55b888ee5ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.301858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-bd1057ec-e223-4995-b201-55b888ee5ff6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:09:43.303072 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bd1057ec-e223-4995-b201-55b888ee5ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:09:43.310677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 740/1494] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:09:43.319824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9aff-f852-43b5-9bcd-839db7e63a8c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.320338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9aff-f852-43b5-9bcd-839db7e63a8c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.320437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9aff-f852-43b5-9bcd-839db7e63a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.338239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-6efe9aff-f852-43b5-9bcd-839db7e63a8c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:09:43.339441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6efe9aff-f852-43b5-9bcd-839db7e63a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:09:43.348192 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 755/1495] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:09:43.352845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1057ec-e223-4995-b201-55b888ee5ff6 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:43.362499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1057ec-e223-4995-b201-55b888ee5ff6 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:43.366923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:43.367572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.367851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.368126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.368842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:09:43.369148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:43.370148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:43.370148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:09:43.370148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:09:43.371051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:43.382443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 741/1496] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:09:43.391105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe9aff-f852-43b5-9bcd-839db7e63a8c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:43.400058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe9aff-f852-43b5-9bcd-839db7e63a8c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:43.405491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:43.406136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.406419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.406731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.407421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:43.409118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING py.warnings [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:43.409118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: warnings.warn(msg) Mar 31 18:09:43.409118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: Mar 31 18:09:43.410300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:43.508796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 756/1497] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:09:43 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:09:43.513115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:43.523703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba6d79-1627-4993-944c-8e0fb888af9d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:43.577893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:43.578485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.578797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.579077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.579757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:43.580769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:43.580769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:09:43.580769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:09:43.581950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:43.645214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 742/1498] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:09:43 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:09:43.649370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:43.660913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751f15-ee8b-4505-96e3-1e18eed59aa9 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:43.665555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:43.670136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.670136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.670136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.670136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:43.670136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING py.warnings [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:43.670136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: warnings.warn(msg) Mar 31 18:09:43.670136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: Mar 31 18:09:43.670787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:43.682306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 757/1499] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:09:43.686987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:43.696735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21e474-2974-4f64-a36f-f96062e2d105 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:43.701947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2181cfa-f64a-4843-8ebd-9ca1815f966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:43.702600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181cfa-f64a-4843-8ebd-9ca1815f966d admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.702911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181cfa-f64a-4843-8ebd-9ca1815f966d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.703191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181cfa-f64a-4843-8ebd-9ca1815f966d admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.703914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2181cfa-f64a-4843-8ebd-9ca1815f966d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:43.704921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-b2181cfa-f64a-4843-8ebd-9ca1815f966d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:43.704921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:09:43.704921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:09:43.705817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2181cfa-f64a-4843-8ebd-9ca1815f966d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:43.719047 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 743/1500] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:09:43.723054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:43.732598 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6a609-7de6-4c6c-baaf-864ab2076bcf admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:43.736962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:43.738841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.738841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.738841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] PATH_INFO: `/v3/projects/9ca54bbf7ee44aecb01db6d08482c0a6/users/a87948a7a30746f88db4e04a877311f3/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.752872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca54bbf7ee44aecb01db6d08482c0a6, user_id=a87948a7a30746f88db4e04a877311f3, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:43.753884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING py.warnings [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:43.753884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: warnings.warn(msg) Mar 31 18:09:43.753884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: Mar 31 18:09:43.755822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:43.820794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 758/1501] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:09:43 2022] PUT /identity/v3/projects/9ca54bbf7ee44aecb01db6d08482c0a6/users/a87948a7a30746f88db4e04a877311f3/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:09:43.832809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a326e-31e5-4ad3-a9f6-4213660f31cf None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:43.833041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a326e-31e5-4ad3-a9f6-4213660f31cf None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:43.833320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a326e-31e5-4ad3-a9f6-4213660f31cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:43.858979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b19a326e-31e5-4ad3-a9f6-4213660f31cf None None] MFA Rules not processed for user `a87948a7a30746f88db4e04a877311f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:09:43.860176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b19a326e-31e5-4ad3-a9f6-4213660f31cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:09:43.923058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 744/1502] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:09:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:09:43.934174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:44.003510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270ac5-2d33-4170-aacc-b93b3115c3a4 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:44.008867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:44.009546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:44.009822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:44.010096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:44.017672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:44.019284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:44.027933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 759/1503] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:09:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:09:44.100963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478ab1-d598-4fbb-a378-193f1e721026 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:44.101258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478ab1-d598-4fbb-a378-193f1e721026 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:44.101540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478ab1-d598-4fbb-a378-193f1e721026 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:44.103281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 745/1504] 10.222.0.58 () {52 vars in 829 bytes} [Thu Mar 31 18:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:09:44.106784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:44.165903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874307-afea-4df2-8e9b-80fadc96f549 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:44.170451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:44.171357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:44.171637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:44.171910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] PATH_INFO: `/v3/users/a87948a7a30746f88db4e04a877311f3` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:44.173097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87948a7a30746f88db4e04a877311f3)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:44.174104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING py.warnings [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:44.174104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: warnings.warn(msg) Mar 31 18:09:44.174104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: Mar 31 18:09:44.175337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:44.406522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87948a7a30746f88db4e04a877311f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:44.407207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87948a7a30746f88db4e04a877311f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:44.419265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87948a7a30746f88db4e04a877311f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:44.501680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87948a7a30746f88db4e04a877311f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:44.502341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87948a7a30746f88db4e04a877311f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:44.526993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 760/1505] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:09:44 2022] DELETE /identity/v3/users/a87948a7a30746f88db4e04a877311f3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:09:44.531814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:44.532331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:44.532434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:44.550005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:09:44.551222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:09:44.607409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 746/1506] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:09:44.617554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:44.618976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:09:44.675377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737ae9-e777-4913-8c91-cd05ff2fd2f9 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:44.678895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641cf11-0b2a-4bc0-a1d3-5d6063a08010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:44.679540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641cf11-0b2a-4bc0-a1d3-5d6063a08010 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:44.679824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641cf11-0b2a-4bc0-a1d3-5d6063a08010 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:44.680103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641cf11-0b2a-4bc0-a1d3-5d6063a08010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:44.689647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641cf11-0b2a-4bc0-a1d3-5d6063a08010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:44.691106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641cf11-0b2a-4bc0-a1d3-5d6063a08010 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:44.700437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 761/1507] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:09:45.161370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:09:45.166863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:09:45.176501 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a055-1bf2-4766-b207-015804d1d68b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:09:45.181444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:09:45.182340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:09:45.182645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:09:45.182955 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] PATH_INFO: `/v3/projects/9ca54bbf7ee44aecb01db6d08482c0a6` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:09:45.184146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca54bbf7ee44aecb01db6d08482c0a6)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:09:45.185858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:09:45.185858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:09:45.185858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:09:45.187208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:09:45.325365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca54bbf7ee44aecb01db6d08482c0a6', 'request_id': 'req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:45.388156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca54bbf7ee44aecb01db6d08482c0a6', 'request_id': 'req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:45.400590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca54bbf7ee44aecb01db6d08482c0a6', 'request_id': 'req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:45.420476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] The token cache is being invalidate because project 9ca54bbf7ee44aecb01db6d08482c0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:09:45.420756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:45.421405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dc0559f9-77ca-4c74-b432-d35c2bb3e58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:09:45.423066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 747/1508] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:09:45 2022] DELETE /identity/v3/projects/9ca54bbf7ee44aecb01db6d08482c0a6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:11:30.778212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075195f-033d-413b-83c8-fd831b9cf74e None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:30.778849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075195f-033d-413b-83c8-fd831b9cf74e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:30.778849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075195f-033d-413b-83c8-fd831b9cf74e None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:30.780601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 762/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:30.785515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c04b-1889-448a-8f5d-72c1dd528431 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:30.785965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c04b-1889-448a-8f5d-72c1dd528431 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:30.786057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c04b-1889-448a-8f5d-72c1dd528431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:30.804980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5293c04b-1889-448a-8f5d-72c1dd528431 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:30.806177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5293c04b-1889-448a-8f5d-72c1dd528431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:30.863305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 748/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:31.018531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075195f-033d-413b-83c8-fd831b9cf74e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:31.020343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a075195f-033d-413b-83c8-fd831b9cf74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:31.096252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075195f-033d-413b-83c8-fd831b9cf74e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:31.102534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071752da-136f-4f4f-b50c-f725036056b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:31.103206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071752da-136f-4f4f-b50c-f725036056b0 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:31.103483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071752da-136f-4f4f-b50c-f725036056b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:31.103754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071752da-136f-4f4f-b50c-f725036056b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:31.111928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071752da-136f-4f4f-b50c-f725036056b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:31.113637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071752da-136f-4f4f-b50c-f725036056b0 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:31.124575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 763/1511] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:11:31.736911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4567-4877-4bcf-b99a-6e3a9ed8bf67 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:31.737494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4567-4877-4bcf-b99a-6e3a9ed8bf67 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:31.737777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4567-4877-4bcf-b99a-6e3a9ed8bf67 None None] PATH_INFO: `/v3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:31.739123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 749/1512] 10.222.0.44 () {54 vars in 925 bytes} [Thu Mar 31 18:11:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:11:31.746029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a34a93-866d-4342-bccc-dc83853430b1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:31.746394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a34a93-866d-4342-bccc-dc83853430b1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:31.746794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a34a93-866d-4342-bccc-dc83853430b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:31.765863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f4a34a93-866d-4342-bccc-dc83853430b1 None None] MFA Rules not processed for user `511e982844c347c8bd49f51aaf29be71`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:31.767164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f4a34a93-866d-4342-bccc-dc83853430b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:31.830831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 764/1513] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Mar 31 18:11:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:11:32.408560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46e0c-7b0b-40e0-b995-d84a11df986d None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:32.409126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46e0c-7b0b-40e0-b995-d84a11df986d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:32.409126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46e0c-7b0b-40e0-b995-d84a11df986d None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:32.411023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:32.416319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1572d-a10c-4bc2-933d-db4524986106 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:32.416630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1572d-a10c-4bc2-933d-db4524986106 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:32.416942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1572d-a10c-4bc2-933d-db4524986106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:32.435027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a0b1572d-a10c-4bc2-933d-db4524986106 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:32.436221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a0b1572d-a10c-4bc2-933d-db4524986106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:32.444517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:32.596810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c46e0c-7b0b-40e0-b995-d84a11df986d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:32.611682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c46e0c-7b0b-40e0-b995-d84a11df986d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:32.617969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73592a-1734-4df5-a287-ae01bd98a0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:32.618632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73592a-1734-4df5-a287-ae01bd98a0ee service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:32.618922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73592a-1734-4df5-a287-ae01bd98a0ee service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:32.619197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73592a-1734-4df5-a287-ae01bd98a0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:32.627433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73592a-1734-4df5-a287-ae01bd98a0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:32.629031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73592a-1734-4df5-a287-ae01bd98a0ee service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:32.638383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 751/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:11:42.316104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8af5-3c3c-4638-8d25-bd0e53b99150 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:42.316667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8af5-3c3c-4638-8d25-bd0e53b99150 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:42.316667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8af5-3c3c-4638-8d25-bd0e53b99150 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:42.319029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 766/1517] 10.222.0.58 () {54 vars in 960 bytes} [Thu Mar 31 18:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:42.324301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1061c-2b8d-4c62-bd3a-3f31e6fc2acc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:42.324751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1061c-2b8d-4c62-bd3a-3f31e6fc2acc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:42.324895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1061c-2b8d-4c62-bd3a-3f31e6fc2acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:42.343171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f5a1061c-2b8d-4c62-bd3a-3f31e6fc2acc None None] MFA Rules not processed for user `511e982844c347c8bd49f51aaf29be71`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:42.344342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f5a1061c-2b8d-4c62-bd3a-3f31e6fc2acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:42.352741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 752/1518] 10.222.0.58 () {58 vars in 1057 bytes} [Thu Mar 31 18:11:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:42.360202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8af5-3c3c-4638-8d25-bd0e53b99150 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:42.373293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8af5-3c3c-4638-8d25-bd0e53b99150 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:42.378125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18826a40-3a8f-49f3-afa5-924ed8018d0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:42.378790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826a40-3a8f-49f3-afa5-924ed8018d0f service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:42.379077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826a40-3a8f-49f3-afa5-924ed8018d0f service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:42.379352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826a40-3a8f-49f3-afa5-924ed8018d0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:42.388111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18826a40-3a8f-49f3-afa5-924ed8018d0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:42.389670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18826a40-3a8f-49f3-afa5-924ed8018d0f service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:42.400520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 767/1519] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:11:44.368738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a4eb-a9a9-4852-84df-2c5155f821f6 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:44.369313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a4eb-a9a9-4852-84df-2c5155f821f6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:44.369313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a4eb-a9a9-4852-84df-2c5155f821f6 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:44.371160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 753/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:44.376250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e79a-6869-4a9a-9528-af66334e7d96 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:44.376669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e79a-6869-4a9a-9528-af66334e7d96 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:44.376828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e79a-6869-4a9a-9528-af66334e7d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:44.395057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8629e79a-6869-4a9a-9528-af66334e7d96 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:44.396969 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8629e79a-6869-4a9a-9528-af66334e7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:44.404780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 768/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:44.565224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a4eb-a9a9-4852-84df-2c5155f821f6 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:44.581410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a4eb-a9a9-4852-84df-2c5155f821f6 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:44.587570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb1f2-fd9a-46d7-9af0-2ea0a405e162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:44.588216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb1f2-fd9a-46d7-9af0-2ea0a405e162 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:44.588498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb1f2-fd9a-46d7-9af0-2ea0a405e162 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:44.588774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb1f2-fd9a-46d7-9af0-2ea0a405e162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:44.597203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bb1f2-fd9a-46d7-9af0-2ea0a405e162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:44.598860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bb1f2-fd9a-46d7-9af0-2ea0a405e162 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:44.608326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 754/1522] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:11:45.897129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61b03b-0c79-4e99-b8a2-2c0422fbba05 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:45.897706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61b03b-0c79-4e99-b8a2-2c0422fbba05 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:45.897706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61b03b-0c79-4e99-b8a2-2c0422fbba05 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:45.899564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 769/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 31 18:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:45.905044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e91765-7fb7-403e-8852-5e9baebdf5d4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:45.905554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e91765-7fb7-403e-8852-5e9baebdf5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:45.905661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e91765-7fb7-403e-8852-5e9baebdf5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:45.924783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-03e91765-7fb7-403e-8852-5e9baebdf5d4 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:45.926007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-03e91765-7fb7-403e-8852-5e9baebdf5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:45.935132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 755/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 31 18:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:46.090251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61b03b-0c79-4e99-b8a2-2c0422fbba05 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:46.104994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61b03b-0c79-4e99-b8a2-2c0422fbba05 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:46.110259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff4293-d8da-4c01-9b29-a5aaabaae218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:46.110941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4293-d8da-4c01-9b29-a5aaabaae218 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:46.111221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4293-d8da-4c01-9b29-a5aaabaae218 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:46.111493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4293-d8da-4c01-9b29-a5aaabaae218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:46.120580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff4293-d8da-4c01-9b29-a5aaabaae218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:46.122149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff4293-d8da-4c01-9b29-a5aaabaae218 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:46.131720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 770/1525] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:11:50.546664 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed831-ef8b-4cef-a0ca-230865cb96fc None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:50.547258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed831-ef8b-4cef-a0ca-230865cb96fc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:50.547258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed831-ef8b-4cef-a0ca-230865cb96fc None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:50.548974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 756/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:50.555142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0edaa-1f0a-40c0-ab5e-dce808e9ee29 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:50.555589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0edaa-1f0a-40c0-ab5e-dce808e9ee29 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:50.555683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0edaa-1f0a-40c0-ab5e-dce808e9ee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:50.574219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-3cd0edaa-1f0a-40c0-ab5e-dce808e9ee29 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:50.575456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3cd0edaa-1f0a-40c0-ab5e-dce808e9ee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:50.583233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 771/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:50.620555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed831-ef8b-4cef-a0ca-230865cb96fc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:50.622233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-16aed831-ef8b-4cef-a0ca-230865cb96fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:50.679108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed831-ef8b-4cef-a0ca-230865cb96fc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:50.682557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e8764-afc6-4c5a-a647-3c7969d4b6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:50.683233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8764-afc6-4c5a-a647-3c7969d4b6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:50.683510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8764-afc6-4c5a-a647-3c7969d4b6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:50.683953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8764-afc6-4c5a-a647-3c7969d4b6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:50.692871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e8764-afc6-4c5a-a647-3c7969d4b6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:50.694963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e8764-afc6-4c5a-a647-3c7969d4b6e3 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:50.704768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 757/1528] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:11:53.084120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3269-0aa6-4305-8552-743a66a2f020 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:53.084941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3269-0aa6-4305-8552-743a66a2f020 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:53.085035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3269-0aa6-4305-8552-743a66a2f020 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:53.086818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 772/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:53.092147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97b93-ac6a-4052-bfe1-98a882053df2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:53.092633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97b93-ac6a-4052-bfe1-98a882053df2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:53.092743 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97b93-ac6a-4052-bfe1-98a882053df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:53.111385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c7c97b93-ac6a-4052-bfe1-98a882053df2 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:53.112588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c7c97b93-ac6a-4052-bfe1-98a882053df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:53.121088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 758/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:53.159442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea3269-0aa6-4305-8552-743a66a2f020 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:53.161266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e2ea3269-0aa6-4305-8552-743a66a2f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:53.175235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea3269-0aa6-4305-8552-743a66a2f020 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:53.179423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591124ec-19dd-4eae-8b05-72f5eebf7830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:53.180070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591124ec-19dd-4eae-8b05-72f5eebf7830 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:53.180410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591124ec-19dd-4eae-8b05-72f5eebf7830 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:53.180631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591124ec-19dd-4eae-8b05-72f5eebf7830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:53.191227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591124ec-19dd-4eae-8b05-72f5eebf7830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:53.192776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591124ec-19dd-4eae-8b05-72f5eebf7830 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:53.203231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 773/1531] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:11:57.508082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd460e-a62b-4ddf-a130-a07d50589b66 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:57.508690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd460e-a62b-4ddf-a130-a07d50589b66 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:57.508690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd460e-a62b-4ddf-a130-a07d50589b66 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:57.510397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 759/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:11:57.515681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237421e-98de-46ae-9243-623cc86ec9ba None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:57.516087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237421e-98de-46ae-9243-623cc86ec9ba None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:57.516238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237421e-98de-46ae-9243-623cc86ec9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:57.535128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0237421e-98de-46ae-9243-623cc86ec9ba None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:11:57.536310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0237421e-98de-46ae-9243-623cc86ec9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:57.545337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 774/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:11:57.800379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd460e-a62b-4ddf-a130-a07d50589b66 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:11:57.802023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-39bd460e-a62b-4ddf-a130-a07d50589b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:11:57.857587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd460e-a62b-4ddf-a130-a07d50589b66 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:11:57.861050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca9340-796a-4160-abc2-de126d5fb5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:11:57.861876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca9340-796a-4160-abc2-de126d5fb5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:11:57.862158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca9340-796a-4160-abc2-de126d5fb5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:11:57.862430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca9340-796a-4160-abc2-de126d5fb5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:11:57.871686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca9340-796a-4160-abc2-de126d5fb5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:11:57.873109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca9340-796a-4160-abc2-de126d5fb5e5 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:11:57.882096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 760/1534] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:12:00.272288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f75af-38cf-4608-a9f9-756d5092bee3 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:12:00.273021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f75af-38cf-4608-a9f9-756d5092bee3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:12:00.273021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f75af-38cf-4608-a9f9-756d5092bee3 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:12:00.274648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 775/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 31 18:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:12:00.279974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b37c-39fa-4f91-9999-c744346fc6da None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:12:00.280386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b37c-39fa-4f91-9999-c744346fc6da None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:12:00.280532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b37c-39fa-4f91-9999-c744346fc6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:12:00.298970 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5bb7b37c-39fa-4f91-9999-c744346fc6da None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:12:00.300154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5bb7b37c-39fa-4f91-9999-c744346fc6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:12:00.309093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 761/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 31 18:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:12:00.566842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1e71-b350-4844-8afd-8bf96f92cc0f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:12:00.567134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1e71-b350-4844-8afd-8bf96f92cc0f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:12:00.567419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1e71-b350-4844-8afd-8bf96f92cc0f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:12:00.570526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 776/1537] 10.222.0.58 () {54 vars in 962 bytes} [Thu Mar 31 18:12:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:12:00.575545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde759dd-3dd1-417b-8247-b1d4bfb771f9 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:12:00.575830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde759dd-3dd1-417b-8247-b1d4bfb771f9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:12:00.576104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde759dd-3dd1-417b-8247-b1d4bfb771f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:12:00.593713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-cde759dd-3dd1-417b-8247-b1d4bfb771f9 None None] MFA Rules not processed for user `95559d1e48934be89e562208ff65d195`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:12:00.594918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cde759dd-3dd1-417b-8247-b1d4bfb771f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:12:00.601667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 762/1538] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Mar 31 18:12:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:12:00.610936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1e71-b350-4844-8afd-8bf96f92cc0f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:12:00.621996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1e71-b350-4844-8afd-8bf96f92cc0f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:12:00.625427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709fa2e-71aa-4715-92ba-d9a1ed28bd5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:12:00.626058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709fa2e-71aa-4715-92ba-d9a1ed28bd5b service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:12:00.626339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709fa2e-71aa-4715-92ba-d9a1ed28bd5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:12:00.626638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709fa2e-71aa-4715-92ba-d9a1ed28bd5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:12:00.635586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709fa2e-71aa-4715-92ba-d9a1ed28bd5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:12:00.637003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709fa2e-71aa-4715-92ba-d9a1ed28bd5b service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:12:00.646186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 777/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:35.363687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7efd15-20c6-48d5-9998-3425673c6e80 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.364285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7efd15-20c6-48d5-9998-3425673c6e80 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.364285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7efd15-20c6-48d5-9998-3425673c6e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.367057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44874658-eea3-488c-9bc0-ad0323ac59b6 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.367561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44874658-eea3-488c-9bc0-ad0323ac59b6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.367669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44874658-eea3-488c-9bc0-ad0323ac59b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.393659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-44874658-eea3-488c-9bc0-ad0323ac59b6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.394992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ee7efd15-20c6-48d5-9998-3425673c6e80 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.395204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-44874658-eea3-488c-9bc0-ad0323ac59b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.396534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ee7efd15-20c6-48d5-9998-3425673c6e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.410164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 778/1540] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:13:35.411567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 763/1541] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:35.421817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ba63-916f-4d0e-a7e2-9b873ac7897e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.422497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ba63-916f-4d0e-a7e2-9b873ac7897e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.422890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ba63-916f-4d0e-a7e2-9b873ac7897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.425024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274c75-b511-47cd-abac-23cd8fd04120 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.425499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274c75-b511-47cd-abac-23cd8fd04120 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.425947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274c75-b511-47cd-abac-23cd8fd04120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.447822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-cbc7ba63-916f-4d0e-a7e2-9b873ac7897e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.458666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-cbc7ba63-916f-4d0e-a7e2-9b873ac7897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.463880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-eb274c75-b511-47cd-abac-23cd8fd04120 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.465371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-eb274c75-b511-47cd-abac-23cd8fd04120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.465823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 779/1542] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:35.470430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ba63-916f-4d0e-a7e2-9b873ac7897e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:35.478599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 764/1543] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:13:35.487283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ba63-916f-4d0e-a7e2-9b873ac7897e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:35.488216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb274c75-b511-47cd-abac-23cd8fd04120 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:35.492578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:35.493426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.493808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.494184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.495247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:35.495666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:35.497377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING py.warnings [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:13:35.497377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: warnings.warn(msg) Mar 31 18:13:35.497377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: Mar 31 18:13:35.506005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fc8e0-a4fe-465d-ac78-392da845daff admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:35.506843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb274c75-b511-47cd-abac-23cd8fd04120 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:35.521358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:35.522367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.522920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.523423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.524359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:35.524854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:35.527365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:35.533897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 780/1544] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:13:35.535643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534c00-b3ff-487c-bfbd-3128f1c94ae9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.535938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534c00-b3ff-487c-bfbd-3128f1c94ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.536222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534c00-b3ff-487c-bfbd-3128f1c94ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.560752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 765/1545] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:13:35.562496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:35.582351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becab61-6e37-4fe7-85e7-f82d53d47ae8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:35.583849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-54534c00-b3ff-487c-bfbd-3128f1c94ae9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.585239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-54534c00-b3ff-487c-bfbd-3128f1c94ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.589300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9f97-7cea-4380-b63e-199634d998bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:35.590339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9f97-7cea-4380-b63e-199634d998bc admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.590827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9f97-7cea-4380-b63e-199634d998bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.591322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9f97-7cea-4380-b63e-199634d998bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.592361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9f97-7cea-4380-b63e-199634d998bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:35.593860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-3e5d9f97-7cea-4380-b63e-199634d998bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:13:35.593860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:13:35.593860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:13:35.604362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9f97-7cea-4380-b63e-199634d998bc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:35.631137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 781/1546] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:35.631992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534c00-b3ff-487c-bfbd-3128f1c94ae9 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:35.644894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534c00-b3ff-487c-bfbd-3128f1c94ae9 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:35.659366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:35.660057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.660336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.660607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.661311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:35.663549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:35.712103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 766/1547] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:35.715342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb66fc-9bc9-44e8-8572-ecec256f5921 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.715904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb66fc-9bc9-44e8-8572-ecec256f5921 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.716526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb66fc-9bc9-44e8-8572-ecec256f5921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.744705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ebeb66fc-9bc9-44e8-8572-ecec256f5921 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.751485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ebeb66fc-9bc9-44e8-8572-ecec256f5921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.799186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 782/1548] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:35.800063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:35.841343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 767/1549] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:35.843188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265017-180e-4a26-83a7-9dca17655f82 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.843805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265017-180e-4a26-83a7-9dca17655f82 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.844255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265017-180e-4a26-83a7-9dca17655f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.875133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-bd265017-180e-4a26-83a7-9dca17655f82 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.876391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bd265017-180e-4a26-83a7-9dca17655f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.926394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974004f-5301-4e37-95a0-d7d96fc75bca admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:35.931708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58781d8-309b-4df3-9106-009ece8bd7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:35.932786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58781d8-309b-4df3-9106-009ece8bd7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.933619 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58781d8-309b-4df3-9106-009ece8bd7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.934102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58781d8-309b-4df3-9106-009ece8bd7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.934798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58781d8-309b-4df3-9106-009ece8bd7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:35.935988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING py.warnings [None req-b58781d8-309b-4df3-9106-009ece8bd7e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:13:35.935988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: warnings.warn(msg) Mar 31 18:13:35.935988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: Mar 31 18:13:35.942730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58781d8-309b-4df3-9106-009ece8bd7e2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:35.947920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 768/1550] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:35.949965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d317-6b48-431c-b436-2faa85d2b681 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:35.949965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d317-6b48-431c-b436-2faa85d2b681 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:35.950292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d317-6b48-431c-b436-2faa85d2b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:35.969710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1d24d317-6b48-431c-b436-2faa85d2b681 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:35.970951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1d24d317-6b48-431c-b436-2faa85d2b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:35.978900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 769/1551] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:35.980349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24d317-6b48-431c-b436-2faa85d2b681 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:35.990466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24d317-6b48-431c-b436-2faa85d2b681 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:35.997049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b15c5-e981-48ea-8a1d-c33648ec7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.003624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b15c5-e981-48ea-8a1d-c33648ec7f3a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.003624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b15c5-e981-48ea-8a1d-c33648ec7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.003624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b15c5-e981-48ea-8a1d-c33648ec7f3a admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.003624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b15c5-e981-48ea-8a1d-c33648ec7f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.003624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b15c5-e981-48ea-8a1d-c33648ec7f3a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.039943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 783/1552] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:36.041471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567841a-9c12-4f3c-ae07-da232cfcb391 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.042667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567841a-9c12-4f3c-ae07-da232cfcb391 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.042967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567841a-9c12-4f3c-ae07-da232cfcb391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.067730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-3567841a-9c12-4f3c-ae07-da232cfcb391 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.068967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3567841a-9c12-4f3c-ae07-da232cfcb391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.077845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 784/1553] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.078709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567841a-9c12-4f3c-ae07-da232cfcb391 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.089601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567841a-9c12-4f3c-ae07-da232cfcb391 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.094247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37132-331b-4e8b-b6c2-8c038a2dcae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.094945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37132-331b-4e8b-b6c2-8c038a2dcae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.095220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37132-331b-4e8b-b6c2-8c038a2dcae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.095498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37132-331b-4e8b-b6c2-8c038a2dcae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.096226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37132-331b-4e8b-b6c2-8c038a2dcae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:36.096534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37132-331b-4e8b-b6c2-8c038a2dcae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.098142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37132-331b-4e8b-b6c2-8c038a2dcae6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.114860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 770/1554] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:35 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:36.114860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992233-8803-4a95-b1a1-7406b07e1c03 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.114860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992233-8803-4a95-b1a1-7406b07e1c03 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.114860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992233-8803-4a95-b1a1-7406b07e1c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.115493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 785/1555] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:36.115493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e971-4767-411d-8c28-5bff19819ab9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.115493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e971-4767-411d-8c28-5bff19819ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.115493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e971-4767-411d-8c28-5bff19819ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.136972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ce992233-8803-4a95-b1a1-7406b07e1c03 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.137189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f926e971-4767-411d-8c28-5bff19819ab9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.144924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ce992233-8803-4a95-b1a1-7406b07e1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.145116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f926e971-4767-411d-8c28-5bff19819ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.145443 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 786/1556] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.146862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63daeb9-e34c-4efa-a3e8-fed133ebe8d6 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.147058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63daeb9-e34c-4efa-a3e8-fed133ebe8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.147343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63daeb9-e34c-4efa-a3e8-fed133ebe8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.149948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 771/1557] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.152996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd24ca-8981-4f08-a048-36d4bc2de8af None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.153466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd24ca-8981-4f08-a048-36d4bc2de8af None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.153938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd24ca-8981-4f08-a048-36d4bc2de8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.174593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f63daeb9-e34c-4efa-a3e8-fed133ebe8d6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.175835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f63daeb9-e34c-4efa-a3e8-fed133ebe8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.178709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-abfd24ca-8981-4f08-a048-36d4bc2de8af None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.180163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-abfd24ca-8981-4f08-a048-36d4bc2de8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.189266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 772/1558] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.190248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 787/1559] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.191512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7bfa9-ffe8-4afb-ad09-bdcadb600823 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.191826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7bfa9-ffe8-4afb-ad09-bdcadb600823 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.192067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7bfa9-ffe8-4afb-ad09-bdcadb600823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.193649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd24ca-8981-4f08-a048-36d4bc2de8af None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.204741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd24ca-8981-4f08-a048-36d4bc2de8af None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.209731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.210416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.210735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.211015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.211758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.213374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.213752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d9f7bfa9-ffe8-4afb-ad09-bdcadb600823 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.215266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d9f7bfa9-ffe8-4afb-ad09-bdcadb600823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.223722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 788/1560] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.224548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7bfa9-ffe8-4afb-ad09-bdcadb600823 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.227976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 773/1561] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:36.228877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.236394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7bfa9-ffe8-4afb-ad09-bdcadb600823 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.239493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fcdae-f88b-4d5a-83ee-a94eef757ea8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.241239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739949af-fdc5-4b47-98ad-1471d5f90938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.241904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739949af-fdc5-4b47-98ad-1471d5f90938 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.242182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739949af-fdc5-4b47-98ad-1471d5f90938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.242457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739949af-fdc5-4b47-98ad-1471d5f90938 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.243248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739949af-fdc5-4b47-98ad-1471d5f90938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.244867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739949af-fdc5-4b47-98ad-1471d5f90938 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.249861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.250537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.250876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.251131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.251883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.253794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.261275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 789/1562] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:36.261275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ab891-69b4-4981-969b-18078e7096c9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.261275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ab891-69b4-4981-969b-18078e7096c9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.261275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ab891-69b4-4981-969b-18078e7096c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.281217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e46ab891-69b4-4981-969b-18078e7096c9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.282429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e46ab891-69b4-4981-969b-18078e7096c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.290279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 790/1563] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.291544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366aba-6b57-407e-835f-d6945bc8278d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.292572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366aba-6b57-407e-835f-d6945bc8278d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.292830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366aba-6b57-407e-835f-d6945bc8278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.316092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ea366aba-6b57-407e-835f-d6945bc8278d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:36.317430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ea366aba-6b57-407e-835f-d6945bc8278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:36.326109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 791/1564] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:36.326944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea366aba-6b57-407e-835f-d6945bc8278d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.336386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea366aba-6b57-407e-835f-d6945bc8278d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.346235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.346947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.347236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.347514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.348255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:36.348561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.350164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.363294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 792/1565] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:36.364126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.374233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9329-8d5d-4cdd-bafd-eb46b84636d8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.379351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 774/1566] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:36.379872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.380190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.380475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.380754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.381481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:36.381790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.383446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.391426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.396955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 793/1567] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:36.398023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.409602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69b66e-7393-4119-95f2-cffc27e92346 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.448529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd80e2-92a7-4fb7-80a4-d9e549a1a5aa admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.453402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.454066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.454347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.454643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.455376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:36.455689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.457292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.469013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.469691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.469967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.470248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.470903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 775/1568] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:36.471070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.471860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.472677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.483145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb73b78-54be-4ac6-a79a-6961772397b0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.487769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.488436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.488752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.489026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.492468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 794/1569] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:36.492639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.492749 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.492848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.502137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ec23d-6eb6-4e2e-9236-dfa06dcf797b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.506810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 776/1570] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:36.506810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.507064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630976fc-593f-4739-b676-a520539b422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.507629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630976fc-593f-4739-b676-a520539b422f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.507949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630976fc-593f-4739-b676-a520539b422f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.508176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630976fc-593f-4739-b676-a520539b422f admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.509897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630976fc-593f-4739-b676-a520539b422f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:36.509897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630976fc-593f-4739-b676-a520539b422f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.511825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630976fc-593f-4739-b676-a520539b422f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.515224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f222db-d67e-4919-a6e0-b209af1dfc4b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.520142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.520808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.521105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.521386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.522125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:36.522400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.524022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.524842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 795/1571] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:36.525668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630976fc-593f-4739-b676-a520539b422f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.541928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 777/1572] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:36.542159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630976fc-593f-4739-b676-a520539b422f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.542275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.547943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.548987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.549163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.549432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.550154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.552079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.554022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063352d-73d4-4733-8dfd-86adaaee4c52 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.560291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.561005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.561287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.561563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.562290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.569176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.739153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 796/1573] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:36.739985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.749848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 778/1574] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:36.750688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:36.766115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822860c-caab-4d7d-90cc-91ef8998161a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.822232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cbfef-4b01-47db-ae6b-1da540b80eee admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:36.825687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.826365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.826681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.826960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.827661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.828161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:36.828873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:36.829196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:36.829619 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:36.829856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.830706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:36.833090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:36.968713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 779/1575] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:36.968713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.008436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 797/1576] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:36 2022] POST /identity/v3/projects => generated 389 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:37.008436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.048560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e262-f350-4008-8a98-29ab70c57f3b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.075928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50080a9-fc3a-441e-bc6f-1392c037f1fc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.091507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.092946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.092946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.092946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] PATH_INFO: `/v3/projects/12eaab25037841428a6ba39920b72361/users/5ad0aaae50bd426086290e36288c5312/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.110219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12eaab25037841428a6ba39920b72361, user_id=5ad0aaae50bd426086290e36288c5312, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.113157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.118909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.119894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.120176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.120453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] PATH_INFO: `/v3/projects/6fa6ff30a9664462a66a7b5f7d7a0231/users/20900a9623ab48da82bb3debc625ae83/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.135918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa6ff30a9664462a66a7b5f7d7a0231, user_id=20900a9623ab48da82bb3debc625ae83, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.139879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:13:37.139879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:13:37.139879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:13:37.139879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.223090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 798/1577] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:37 2022] PUT /identity/v3/projects/12eaab25037841428a6ba39920b72361/users/5ad0aaae50bd426086290e36288c5312/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:37.224209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.236129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 780/1578] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:36 2022] PUT /identity/v3/projects/6fa6ff30a9664462a66a7b5f7d7a0231/users/20900a9623ab48da82bb3debc625ae83/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:37.237038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.302119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391650-0b1e-4e61-bc55-28387ee53484 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.307370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.308033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.308386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.308668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.309213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8b3e4-690b-4b3b-8b27-69b7d30d455c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.309358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.311304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.314340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.315039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.315325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.315603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.316312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.318225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.441537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 799/1579] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:37.442509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.462786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 781/1580] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/projects => generated 393 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:37.464508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.514533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6be0a-2744-48fc-8543-4fea4e1b07b7 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.530837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3010b-5ec9-4195-85e4-605e787648e8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.535441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.536112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.536392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.536661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.537387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.539018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.549727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 782/1581] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:37.550552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.561436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c49e5-58aa-43c6-9e4b-a38b3f2c6ff2 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.566043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.566757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.567044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.567320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.568026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.569971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.579113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ca3b6-c33f-46b2-aa5e-4367a83f3297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.579797 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca3b6-c33f-46b2-aa5e-4367a83f3297 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.580070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca3b6-c33f-46b2-aa5e-4367a83f3297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.580342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca3b6-c33f-46b2-aa5e-4367a83f3297 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.581031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ca3b6-c33f-46b2-aa5e-4367a83f3297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.582988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ca3b6-c33f-46b2-aa5e-4367a83f3297 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.697681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 783/1582] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:37.699227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.709297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e710ba-017e-4c8e-a421-5edd14ea3e7f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.714674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.715348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.715631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.715909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.716694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.718649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.730433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 800/1583] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:37.731935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f05aa0-e26d-4157-8e43-4eb580907734 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.732225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f05aa0-e26d-4157-8e43-4eb580907734 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.732498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f05aa0-e26d-4157-8e43-4eb580907734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.759807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-94f05aa0-e26d-4157-8e43-4eb580907734 None None] MFA Rules not processed for user `5ad0aaae50bd426086290e36288c5312`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:37.762379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-94f05aa0-e26d-4157-8e43-4eb580907734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:37.828597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 801/1584] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:37.834108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 784/1585] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:37.842662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e666e-3792-45b0-a670-90baaf96f74b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.842662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e666e-3792-45b0-a670-90baaf96f74b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.842922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.843070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e666e-3792-45b0-a670-90baaf96f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.843829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1427122-4246-45ec-a06b-616e4ea867df admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.849067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.849759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.850038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.850313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.851057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.852971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.869339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-fa2e666e-3792-45b0-a670-90baaf96f74b None None] MFA Rules not processed for user `20900a9623ab48da82bb3debc625ae83`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:37.877932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-fa2e666e-3792-45b0-a670-90baaf96f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:37.946275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 802/1586] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:37.947267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e666e-3792-45b0-a670-90baaf96f74b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.958402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e666e-3792-45b0-a670-90baaf96f74b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.966968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 785/1587] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:37.967808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:37.967982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.968670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.968949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.969225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.970041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.972173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.980114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd688d4-9f7d-4a3a-b035-d8d053f8248d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:37.984968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:37.985648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:37.985933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:37.986209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:37.986979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:37.988582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:37.999903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 786/1588] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.005257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.011967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488ff18-d2fc-474b-b410-5f8950ec634b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.016702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.017372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.017654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.017919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.018764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.020490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.032373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 787/1589] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.033296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.043956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9636479-4547-427f-bbac-c4c1354f028c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.049300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c51314-c016-44d3-810c-78f9ebc82664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.050275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c51314-c016-44d3-810c-78f9ebc82664 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.050563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c51314-c016-44d3-810c-78f9ebc82664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.050870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c51314-c016-44d3-810c-78f9ebc82664 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.051604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c51314-c016-44d3-810c-78f9ebc82664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.053247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c51314-c016-44d3-810c-78f9ebc82664 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.063859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 803/1590] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:37 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:38.064941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.068938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 788/1591] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.068938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d40f-8e71-4218-b61b-027d5ce75c0a None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.068938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d40f-8e71-4218-b61b-027d5ce75c0a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.068938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d40f-8e71-4218-b61b-027d5ce75c0a None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.069900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 789/1592] 10.222.0.58 () {54 vars in 960 bytes} [Thu Mar 31 18:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:13:38.070584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d40f-8e71-4218-b61b-027d5ce75c0a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.077223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33305-6f4b-4f9e-9f5a-7ea68a0d6116 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.085652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.085652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.085652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.085652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.086083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.086083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.096282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 804/1593] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.097128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.100648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d40f-8e71-4218-b61b-027d5ce75c0a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.108654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.109158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307985-2757-4866-a071-d58ea4c6424c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.109357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.109643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.111055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.111055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.112899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.114267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.114960 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.115238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.115510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.116361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.117818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.133017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 805/1594] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.133017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.144176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f14b4-1b92-45ae-ac21-af5977c4424b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.148992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.149884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.150162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.150437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] PATH_INFO: `/v3/projects/02ed38429c7a482d9b048c869783abf6/users/9d94abd38a5f440c9fa68ef9cd67604b/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.166450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ed38429c7a482d9b048c869783abf6, user_id=9d94abd38a5f440c9fa68ef9cd67604b, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.169953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.236993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 790/1595] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:38 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:38.238099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.263724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 806/1596] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:38 2022] PUT /identity/v3/projects/02ed38429c7a482d9b048c869783abf6/users/9d94abd38a5f440c9fa68ef9cd67604b/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:38.268446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.309308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86981e3-8f40-4acf-8cd6-4c4d82fe5f70 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.330924 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398257f-c74f-4448-8bbb-4ef752a2bead admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.335597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.336324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.336544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.336819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.337547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.339191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.351115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 807/1597] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.351115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.360920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf08c2-9380-4f50-b5dc-80c2ae3ff74a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.366794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938c800-8951-438d-8dbc-2b2896f8774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.367003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.367464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c800-8951-438d-8dbc-2b2896f8774d admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.367712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.367827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c800-8951-438d-8dbc-2b2896f8774d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.367991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.368115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c800-8951-438d-8dbc-2b2896f8774d admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.368260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.368705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938c800-8951-438d-8dbc-2b2896f8774d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.368979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.370916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938c800-8951-438d-8dbc-2b2896f8774d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.371294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.381429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 808/1598] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.385207 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 791/1599] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.385384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662803-e1d9-4e13-a9fb-8864cdff16c6 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.385384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662803-e1d9-4e13-a9fb-8864cdff16c6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.385384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662803-e1d9-4e13-a9fb-8864cdff16c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.385728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.395198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837836-0f01-4de8-9f7a-cc5297c4b985 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.400156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.400840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.401126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.401467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.402208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.402693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7a662803-e1d9-4e13-a9fb-8864cdff16c6 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:38.403884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7a662803-e1d9-4e13-a9fb-8864cdff16c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:38.404067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.414311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 792/1600] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.415188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.428744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162348e0-2c2d-47b5-a668-b1909b41a873 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.434867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.435828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.437397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.437773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.443624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.449234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.456659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 793/1601] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.457480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.472543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f111c-78eb-488a-bfb9-6d4b9e21ab4e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.477782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.478938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.479912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.480344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.481315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.483952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.484374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 809/1602] 10.222.0.58 () {58 vars in 1057 bytes} [Thu Mar 31 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:38.485682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919347-cda3-4aeb-be5f-1a67051a5f3b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.485973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919347-cda3-4aeb-be5f-1a67051a5f3b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.486252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919347-cda3-4aeb-be5f-1a67051a5f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.519217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e4919347-cda3-4aeb-be5f-1a67051a5f3b None None] MFA Rules not processed for user `9d94abd38a5f440c9fa68ef9cd67604b`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:38.520411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e4919347-cda3-4aeb-be5f-1a67051a5f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:38.583459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 794/1603] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:38 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:38.584310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.587512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 810/1604] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:38.588493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919347-cda3-4aeb-be5f-1a67051a5f3b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.598927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c036b12-768b-4720-bf81-b683dace3bf7 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.603289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919347-cda3-4aeb-be5f-1a67051a5f3b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.604264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.605580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.605966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.606341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.607244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.608793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.609043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.609696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.609992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.610327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] PATH_INFO: `/v3/projects/23366fa77e9049af8c183f6959cc158f/users/ed1dacde91404110b259cfab7a37bb80/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.619971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 795/1605] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:38.621257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.625718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23366fa77e9049af8c183f6959cc158f, user_id=ed1dacde91404110b259cfab7a37bb80, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.628412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.633155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541395a1-e6b2-40d8-8bf2-c912d2a4e0f3 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.641908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.646192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.646192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.646192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] PATH_INFO: `/v3/projects/360d519a088a46d99a916c1663406cef/users/410abbe38edc4578bd0216ceb334ed5c/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.660292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360d519a088a46d99a916c1663406cef, user_id=410abbe38edc4578bd0216ceb334ed5c, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.663029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.714629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 811/1606] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:38 2022] PUT /identity/v3/projects/23366fa77e9049af8c183f6959cc158f/users/ed1dacde91404110b259cfab7a37bb80/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:38.715461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.743109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 796/1607] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:38 2022] PUT /identity/v3/projects/360d519a088a46d99a916c1663406cef/users/410abbe38edc4578bd0216ceb334ed5c/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:38.743936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.785873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2dafe-71b9-49fb-b67a-bc66d63b37b1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.817020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbcaaa-308a-4760-b66f-58070c593c20 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:38.824142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.825636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.825915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.826187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] PATH_INFO: `/v3/projects/d00c6a06c3384eb782d9d68ea83d7da2/users/7fc41e54ee1a444ebb99229b6f161c0b/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.852638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00c6a06c3384eb782d9d68ea83d7da2, user_id=7fc41e54ee1a444ebb99229b6f161c0b, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.852638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.854987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:38.856659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:38.856941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:38.857219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] PATH_INFO: `/v3/projects/eb7248f2c93342cd823f385c53a69d05/users/b1092332ac6040c597d28a4207c1ce86/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:38.878698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7248f2c93342cd823f385c53a69d05, user_id=b1092332ac6040c597d28a4207c1ce86, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:38.881367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:38.932092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 797/1608] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:38 2022] PUT /identity/v3/projects/d00c6a06c3384eb782d9d68ea83d7da2/users/7fc41e54ee1a444ebb99229b6f161c0b/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:38.932988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:38.998790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 812/1609] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:38 2022] PUT /identity/v3/projects/eb7248f2c93342cd823f385c53a69d05/users/b1092332ac6040c597d28a4207c1ce86/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:38.998790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.005390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef6967-4900-4644-a4e1-819bbe687eef admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.064763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ccf2e-6a5f-480f-9591-924ef789159a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.070177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341bd01-ff1a-4f0b-b938-66a992bc8baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.071330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341bd01-ff1a-4f0b-b938-66a992bc8baf admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.071668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341bd01-ff1a-4f0b-b938-66a992bc8baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.071951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341bd01-ff1a-4f0b-b938-66a992bc8baf admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.072723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341bd01-ff1a-4f0b-b938-66a992bc8baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.075606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341bd01-ff1a-4f0b-b938-66a992bc8baf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.081702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a595b6-d254-4d4d-be4c-a666b5b1e589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.082356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a595b6-d254-4d4d-be4c-a666b5b1e589 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.082692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a595b6-d254-4d4d-be4c-a666b5b1e589 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.082970 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a595b6-d254-4d4d-be4c-a666b5b1e589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.086423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 813/1610] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:39.087821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9f01c-6e40-490d-8a78-0cb61c40c377 None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.088106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9f01c-6e40-490d-8a78-0cb61c40c377 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.088379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9f01c-6e40-490d-8a78-0cb61c40c377 None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.090705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 814/1611] 10.222.0.58 () {54 vars in 960 bytes} [Thu Mar 31 18:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:13:39.091399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9f01c-6e40-490d-8a78-0cb61c40c377 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.105603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9f01c-6e40-490d-8a78-0cb61c40c377 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.114499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511f021-d7c9-4ed9-a10c-75d151f28ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.115430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f021-d7c9-4ed9-a10c-75d151f28ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.115711 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f021-d7c9-4ed9-a10c-75d151f28ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.115994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f021-d7c9-4ed9-a10c-75d151f28ec8 admin admin] PATH_INFO: `/v3/projects/6fc2eb72902a441ca6a6fa9350ce75f8/users/d6a93e87d6894cfd9b7948274f1d7b70/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.133247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511f021-d7c9-4ed9-a10c-75d151f28ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc2eb72902a441ca6a6fa9350ce75f8, user_id=d6a93e87d6894cfd9b7948274f1d7b70, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.136574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511f021-d7c9-4ed9-a10c-75d151f28ec8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.144587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a595b6-d254-4d4d-be4c-a666b5b1e589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.148510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a595b6-d254-4d4d-be4c-a666b5b1e589 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.158436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 798/1612] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:39.160268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f46b-29ee-4698-b39a-617abd8cda36 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.160555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f46b-29ee-4698-b39a-617abd8cda36 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.160830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f46b-29ee-4698-b39a-617abd8cda36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.179496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0867f46b-29ee-4698-b39a-617abd8cda36 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:39.181184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0867f46b-29ee-4698-b39a-617abd8cda36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:39.189624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 799/1613] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:39.190910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431908-e626-4685-badf-4f0303a691fb None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.191200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431908-e626-4685-badf-4f0303a691fb None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.191478 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431908-e626-4685-badf-4f0303a691fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.205916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 815/1614] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:39 2022] PUT /identity/v3/projects/6fc2eb72902a441ca6a6fa9350ce75f8/users/d6a93e87d6894cfd9b7948274f1d7b70/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:39.208400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f6a7-6bc4-456d-bc6b-31b3253c1f0f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.209367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f6a7-6bc4-456d-bc6b-31b3253c1f0f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.209660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f6a7-6bc4-456d-bc6b-31b3253c1f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.226684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2c431908-e626-4685-badf-4f0303a691fb None None] MFA Rules not processed for user `410abbe38edc4578bd0216ceb334ed5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:39.227928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2c431908-e626-4685-badf-4f0303a691fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:39.244176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0417f6a7-6bc4-456d-bc6b-31b3253c1f0f None None] MFA Rules not processed for user `7fc41e54ee1a444ebb99229b6f161c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:39.246068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0417f6a7-6bc4-456d-bc6b-31b3253c1f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:39.300262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 800/1615] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:39.301426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7457-f13a-4d1d-afdd-5fc7d88df4ac None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.301721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7457-f13a-4d1d-afdd-5fc7d88df4ac None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.301995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7457-f13a-4d1d-afdd-5fc7d88df4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.321741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f83c7457-f13a-4d1d-afdd-5fc7d88df4ac None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:39.322975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f83c7457-f13a-4d1d-afdd-5fc7d88df4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:39.338889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 816/1616] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:39.340348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f6a7-6bc4-456d-bc6b-31b3253c1f0f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.392360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 801/1617] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:39.393603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af053de5-a9c1-4375-aa75-b14916b0f684 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.393898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af053de5-a9c1-4375-aa75-b14916b0f684 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.394172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af053de5-a9c1-4375-aa75-b14916b0f684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.414661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-af053de5-a9c1-4375-aa75-b14916b0f684 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:39.415880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-af053de5-a9c1-4375-aa75-b14916b0f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:39.419917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f6a7-6bc4-456d-bc6b-31b3253c1f0f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.426482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e288c-ef4a-4d0d-bfbf-adbb1f7a4d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.427921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e288c-ef4a-4d0d-bfbf-adbb1f7a4d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.428422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e288c-ef4a-4d0d-bfbf-adbb1f7a4d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.428875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e288c-ef4a-4d0d-bfbf-adbb1f7a4d34 admin admin] PATH_INFO: `/v3/projects/460a719e905946b690e19a11f166933c/users/c96dcc79b6bc452ebac1fb3009ee0a73/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.446912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e288c-ef4a-4d0d-bfbf-adbb1f7a4d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460a719e905946b690e19a11f166933c, user_id=c96dcc79b6bc452ebac1fb3009ee0a73, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.450331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e288c-ef4a-4d0d-bfbf-adbb1f7a4d34 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.486988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 802/1618] 10.222.0.58 () {58 vars in 1057 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:39.487930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af053de5-a9c1-4375-aa75-b14916b0f684 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.545650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af053de5-a9c1-4375-aa75-b14916b0f684 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.549613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.550274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.550546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.550844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.554500 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 817/1619] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:39 2022] PUT /identity/v3/projects/460a719e905946b690e19a11f166933c/users/c96dcc79b6bc452ebac1fb3009ee0a73/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:39.555908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f35b-d258-44f7-bff5-26dd32811f72 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.556373 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f35b-d258-44f7-bff5-26dd32811f72 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.556654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f35b-d258-44f7-bff5-26dd32811f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.562236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.565671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.575106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 803/1620] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:39.575938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.579419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-86c1f35b-d258-44f7-bff5-26dd32811f72 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:39.580647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-86c1f35b-d258-44f7-bff5-26dd32811f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:39.586216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4525560-f4e6-463f-a340-2c8c7b77b5a2 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.646694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4bb8d-5902-4814-9bb1-56efbbf9793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.647445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4bb8d-5902-4814-9bb1-56efbbf9793a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.647732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4bb8d-5902-4814-9bb1-56efbbf9793a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.648038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4bb8d-5902-4814-9bb1-56efbbf9793a admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.648748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4bb8d-5902-4814-9bb1-56efbbf9793a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.650689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4bb8d-5902-4814-9bb1-56efbbf9793a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.653926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 818/1621] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:39.654550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f35b-d258-44f7-bff5-26dd32811f72 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.664088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f35b-d258-44f7-bff5-26dd32811f72 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.671096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.671759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.672059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.672314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.673262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.675206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.754596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 804/1622] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:39.755972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c2ec-cea3-48b4-aab2-807a7e8c2f98 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.756273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c2ec-cea3-48b4-aab2-807a7e8c2f98 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.757040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c2ec-cea3-48b4-aab2-807a7e8c2f98 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.758256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 805/1623] 10.222.0.58 () {54 vars in 912 bytes} [Thu Mar 31 18:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:13:39.759064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198c2ec-cea3-48b4-aab2-807a7e8c2f98 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.801041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 819/1624] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:39 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:39.802384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.826096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198c2ec-cea3-48b4-aab2-807a7e8c2f98 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.882788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ef692-3e6f-486a-8dbe-f75c5e91eb9d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:39.890589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.891300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.891585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.892305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.898259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:39.900105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:39.900386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:39.900660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:39.968031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.969965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.981167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:39.982193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 820/1625] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:39.983550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:39.991762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:39.999747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 806/1626] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:40.001063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.009989 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644d018-40af-49df-ac0a-86cf87427e77 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.014545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608094-63ff-49ca-9195-b82178e05f67 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.019506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acefdc-7d09-4bb9-8354-4f89b4f01be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.021894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acefdc-7d09-4bb9-8354-4f89b4f01be5 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.021894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acefdc-7d09-4bb9-8354-4f89b4f01be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.022156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.022270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acefdc-7d09-4bb9-8354-4f89b4f01be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.022372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.022372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.022372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.024425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.027912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.033068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acefdc-7d09-4bb9-8354-4f89b4f01be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.034256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acefdc-7d09-4bb9-8354-4f89b4f01be5 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.038943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 821/1627] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:40.039577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.050308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 807/1628] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:40.052036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae041-2ae5-460a-9275-1403ee529025 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.052334 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae041-2ae5-460a-9275-1403ee529025 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.052612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae041-2ae5-460a-9275-1403ee529025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.053465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52b794-1ee3-4eb9-bf7d-6c3306e2b066 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.059283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.060020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.060306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.060585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.062029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.064479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.077376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ed6ae041-2ae5-460a-9275-1403ee529025 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:40.078590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ed6ae041-2ae5-460a-9275-1403ee529025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:40.091317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 808/1629] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:40.094690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae041-2ae5-460a-9275-1403ee529025 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.108006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae041-2ae5-460a-9275-1403ee529025 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.114258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.114258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.114628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.114919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.115831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.117824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.170065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 822/1630] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:40 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:40.170065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.181568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d04f-1e66-4c44-9498-fc80da65a887 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.189382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.190558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.191013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.191131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] PATH_INFO: `/v3/projects/460a719e905946b690e19a11f166933c/users/c96dcc79b6bc452ebac1fb3009ee0a73/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.193236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=460a719e905946b690e19a11f166933c, user_id=c96dcc79b6bc452ebac1fb3009ee0a73, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.196953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.215452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 823/1631] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:40 2022] PUT /identity/v3/projects/460a719e905946b690e19a11f166933c/users/c96dcc79b6bc452ebac1fb3009ee0a73/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:40.216013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.240085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 809/1632] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:40 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:40.241239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.256613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68aaab-a2e2-4843-9a1d-33fa0448dbe6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.303917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9457ae-ea83-4dd9-8ba4-a93d22715bbc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.310343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.311229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.312523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.312970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.377820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330182f-7042-4dad-b541-3bdae20a80d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.379113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330182f-7042-4dad-b541-3bdae20a80d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.379492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330182f-7042-4dad-b541-3bdae20a80d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.379845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330182f-7042-4dad-b541-3bdae20a80d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.380688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330182f-7042-4dad-b541-3bdae20a80d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.383272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330182f-7042-4dad-b541-3bdae20a80d4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.395813 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 810/1633] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:40.397304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031b0fb-2e38-4a17-887f-a57c1d31dcf3 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.397697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031b0fb-2e38-4a17-887f-a57c1d31dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.398044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031b0fb-2e38-4a17-887f-a57c1d31dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.413789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.415327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.430738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-3031b0fb-2e38-4a17-887f-a57c1d31dcf3 None None] MFA Rules not processed for user `c96dcc79b6bc452ebac1fb3009ee0a73`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:40.432069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3031b0fb-2e38-4a17-887f-a57c1d31dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:40.432240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 824/1634] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:40.434078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.447079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee68e0-9cbe-4313-b57e-c12629fce2f0 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.453144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab953af-91d4-4afc-babb-53be021267a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.454197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab953af-91d4-4afc-babb-53be021267a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.454197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab953af-91d4-4afc-babb-53be021267a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.454414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab953af-91d4-4afc-babb-53be021267a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.455177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab953af-91d4-4afc-babb-53be021267a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.457251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab953af-91d4-4afc-babb-53be021267a9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.471592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 825/1635] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:40.472800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8763-0fa8-47d6-9777-792953f730de None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.473144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8763-0fa8-47d6-9777-792953f730de None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.473475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8763-0fa8-47d6-9777-792953f730de None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.481219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 826/1636] 10.222.0.58 () {54 vars in 912 bytes} [Thu Mar 31 18:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:13:40.481219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8763-0fa8-47d6-9777-792953f730de None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.491439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8763-0fa8-47d6-9777-792953f730de None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.498527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304628d8-e41e-43d1-b027-3ce7651098c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.500912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304628d8-e41e-43d1-b027-3ce7651098c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.500912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304628d8-e41e-43d1-b027-3ce7651098c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.500912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304628d8-e41e-43d1-b027-3ce7651098c8 admin admin] PATH_INFO: `/v3/projects/bf678a54583549fb81064cf0a9e5d0d7/users/3d8e59acdb084b5185e8f7dfab911bb5/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.519341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304628d8-e41e-43d1-b027-3ce7651098c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf678a54583549fb81064cf0a9e5d0d7, user_id=3d8e59acdb084b5185e8f7dfab911bb5, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.522712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304628d8-e41e-43d1-b027-3ce7651098c8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.549750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 811/1637] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:40.550746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031b0fb-2e38-4a17-887f-a57c1d31dcf3 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.563998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031b0fb-2e38-4a17-887f-a57c1d31dcf3 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.569979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.575656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.575656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.575656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] PATH_INFO: `/v3/projects/87ee5311fdca44299a05295c7364afd2/users/ef38f04e415348bd8c33d388f53c1b43/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.595588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ee5311fdca44299a05295c7364afd2, user_id=ef38f04e415348bd8c33d388f53c1b43, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.600827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.647423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 827/1638] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:40 2022] PUT /identity/v3/projects/bf678a54583549fb81064cf0a9e5d0d7/users/3d8e59acdb084b5185e8f7dfab911bb5/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:40.648968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917771c-f05e-43c0-a4af-2de461a4127d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.649274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917771c-f05e-43c0-a4af-2de461a4127d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.649571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917771c-f05e-43c0-a4af-2de461a4127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.675170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2917771c-f05e-43c0-a4af-2de461a4127d None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:40.677051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2917771c-f05e-43c0-a4af-2de461a4127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:40.715048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 812/1639] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:40 2022] PUT /identity/v3/projects/87ee5311fdca44299a05295c7364afd2/users/ef38f04e415348bd8c33d388f53c1b43/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:40.715995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.779495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 828/1640] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:40.780806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917771c-f05e-43c0-a4af-2de461a4127d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:40.787217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff21446-6842-4135-96f7-f9786b34818d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.791099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:40.791889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:40.793374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:40.793374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:40.858274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917771c-f05e-43c0-a4af-2de461a4127d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:40.865879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:40.867791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:40.881048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 813/1641] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:40.882210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:41.012965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:41.013777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.019019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.019554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.021652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:41.030501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:41.031576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb391df0-ff25-4f16-bd70-eb4c4e6a17f4 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:41.046257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:41.047115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.047347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.049845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.050580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:41.056234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:41.063381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 829/1642] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:41.063744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:41.076914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 814/1643] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:41.084565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd7cf9-deff-47eb-ac45-6f55d4964c1b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:41.094701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:41.100118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:41.101128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.106966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.107507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] PATH_INFO: `/v3/projects/bf678a54583549fb81064cf0a9e5d0d7/users/3d8e59acdb084b5185e8f7dfab911bb5/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.111413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf678a54583549fb81064cf0a9e5d0d7, user_id=3d8e59acdb084b5185e8f7dfab911bb5, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:41.112532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c1d88-7949-4a46-8070-69e7c536f9dc admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:41.114584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:41.117871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3afdf-11c6-4825-a8c7-9b7dbc645e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:41.118854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3afdf-11c6-4825-a8c7-9b7dbc645e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.119169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3afdf-11c6-4825-a8c7-9b7dbc645e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.119443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3afdf-11c6-4825-a8c7-9b7dbc645e33 admin admin] PATH_INFO: `/v3/projects/87ee5311fdca44299a05295c7364afd2/users/ef38f04e415348bd8c33d388f53c1b43/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.122347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3afdf-11c6-4825-a8c7-9b7dbc645e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ee5311fdca44299a05295c7364afd2, user_id=ef38f04e415348bd8c33d388f53c1b43, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:41.125109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3afdf-11c6-4825-a8c7-9b7dbc645e33 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:41.133188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 830/1644] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:41 2022] PUT /identity/v3/projects/bf678a54583549fb81064cf0a9e5d0d7/users/3d8e59acdb084b5185e8f7dfab911bb5/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:41.134351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:41.138809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 815/1645] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:41 2022] PUT /identity/v3/projects/87ee5311fdca44299a05295c7364afd2/users/ef38f04e415348bd8c33d388f53c1b43/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:13:41.144210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6730-6888-4b8c-ba94-406a6926d323 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.145121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6730-6888-4b8c-ba94-406a6926d323 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.145973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6730-6888-4b8c-ba94-406a6926d323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.205260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-8ecf6730-6888-4b8c-ba94-406a6926d323 None None] MFA Rules not processed for user `3d8e59acdb084b5185e8f7dfab911bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:41.207673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8ecf6730-6888-4b8c-ba94-406a6926d323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:41.241899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f997517-a101-46b2-b821-5969868bcd9e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:41.317151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5281e-6e09-4ed3-b2dc-d8ae897bd83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:41.329088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5281e-6e09-4ed3-b2dc-d8ae897bd83c service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.329088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5281e-6e09-4ed3-b2dc-d8ae897bd83c service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.329088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5281e-6e09-4ed3-b2dc-d8ae897bd83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.357046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 816/1646] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:13:41.358527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11593c5-ac65-427c-b3bf-9fac8e82d92d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.358889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11593c5-ac65-427c-b3bf-9fac8e82d92d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.359109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11593c5-ac65-427c-b3bf-9fac8e82d92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.403096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d11593c5-ac65-427c-b3bf-9fac8e82d92d None None] MFA Rules not processed for user `ef38f04e415348bd8c33d388f53c1b43`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:41.404332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d11593c5-ac65-427c-b3bf-9fac8e82d92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:41.458766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5281e-6e09-4ed3-b2dc-d8ae897bd83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:41.462569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5281e-6e09-4ed3-b2dc-d8ae897bd83c service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:41.483737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 831/1647] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:41.486993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e179-4b9e-4d97-9dbc-11357c1f8415 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.487487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e179-4b9e-4d97-9dbc-11357c1f8415 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.487940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e179-4b9e-4d97-9dbc-11357c1f8415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.529730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d900e179-4b9e-4d97-9dbc-11357c1f8415 None None] MFA Rules not processed for user `ed1dacde91404110b259cfab7a37bb80`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:41.531246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d900e179-4b9e-4d97-9dbc-11357c1f8415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:41.534808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 817/1648] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:41.691503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 832/1649] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:41.702216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505eca-0118-49c6-969b-ac3de0421187 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.702815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505eca-0118-49c6-969b-ac3de0421187 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.702815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505eca-0118-49c6-969b-ac3de0421187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.721290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f7505eca-0118-49c6-969b-ac3de0421187 None None] MFA Rules not processed for user `ed1dacde91404110b259cfab7a37bb80`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:41.722520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f7505eca-0118-49c6-969b-ac3de0421187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:41.731764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 818/1650] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:41.786403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e179-4b9e-4d97-9dbc-11357c1f8415 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:41.802401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e179-4b9e-4d97-9dbc-11357c1f8415 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:41.819662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:41.820641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:41.820923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:41.821241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:41.833861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:41.836477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:41.848608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 833/1651] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:42.013895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7505eca-0118-49c6-969b-ac3de0421187 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:42.024157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7505eca-0118-49c6-969b-ac3de0421187 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:42.028320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67b0a-124e-4cd8-87da-2ab9d504c1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:42.029110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67b0a-124e-4cd8-87da-2ab9d504c1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:42.029316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67b0a-124e-4cd8-87da-2ab9d504c1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:42.029587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67b0a-124e-4cd8-87da-2ab9d504c1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:42.040290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d67b0a-124e-4cd8-87da-2ab9d504c1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:42.041754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d67b0a-124e-4cd8-87da-2ab9d504c1c4 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:42.054142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 819/1652] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:42.278370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:42.300143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77835b-7e1f-46c4-870b-4e82d94732ab service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:42.307332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c48e22-4d89-4ba5-a1b4-ba3b33381055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:42.311548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c48e22-4d89-4ba5-a1b4-ba3b33381055 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:42.311548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c48e22-4d89-4ba5-a1b4-ba3b33381055 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:42.311826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c48e22-4d89-4ba5-a1b4-ba3b33381055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:42.321734 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c48e22-4d89-4ba5-a1b4-ba3b33381055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:42.326381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c48e22-4d89-4ba5-a1b4-ba3b33381055 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:42.334515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 834/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:42.955098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0cd18-7382-414d-9981-e231f8541a6d None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:42.955769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0cd18-7382-414d-9981-e231f8541a6d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:42.955769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0cd18-7382-414d-9981-e231f8541a6d None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:42.957442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 820/1654] 10.222.0.58 () {54 vars in 912 bytes} [Thu Mar 31 18:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:13:42.967266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124c39-7e20-43cd-b2c2-036d9f07b997 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:42.967817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124c39-7e20-43cd-b2c2-036d9f07b997 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:42.967817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124c39-7e20-43cd-b2c2-036d9f07b997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:43.062647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1f124c39-7e20-43cd-b2c2-036d9f07b997 None None] MFA Rules not processed for user `7436a3068f6545a4b74c877c5b8c81c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:43.066721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1f124c39-7e20-43cd-b2c2-036d9f07b997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:43.194600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 835/1655] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:13:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:43.207599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0cd18-7382-414d-9981-e231f8541a6d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:43.230409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0cd18-7382-414d-9981-e231f8541a6d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:43.239511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe1cd-2bb6-4c54-ac53-0fec8b720646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:43.240187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe1cd-2bb6-4c54-ac53-0fec8b720646 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:43.240623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe1cd-2bb6-4c54-ac53-0fec8b720646 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:43.240739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe1cd-2bb6-4c54-ac53-0fec8b720646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:43.253860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe1cd-2bb6-4c54-ac53-0fec8b720646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:43.255363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe1cd-2bb6-4c54-ac53-0fec8b720646 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:43.274845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 821/1656] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:44.131660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be02f-6190-4526-a108-fa18ed0f57de None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:44.132480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be02f-6190-4526-a108-fa18ed0f57de None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:44.132917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be02f-6190-4526-a108-fa18ed0f57de None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:44.136963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 836/1657] 10.222.0.58 () {54 vars in 960 bytes} [Thu Mar 31 18:13:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:13:44.146769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf399e8-9425-4b28-b721-ff3e3df8ac9b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:44.146769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf399e8-9425-4b28-b721-ff3e3df8ac9b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:44.146769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf399e8-9425-4b28-b721-ff3e3df8ac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:44.181120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-9bf399e8-9425-4b28-b721-ff3e3df8ac9b None None] MFA Rules not processed for user `511e982844c347c8bd49f51aaf29be71`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:44.183371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9bf399e8-9425-4b28-b721-ff3e3df8ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:44.267162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191be02f-6190-4526-a108-fa18ed0f57de None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:44.341699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 822/1658] 10.222.0.58 () {58 vars in 1057 bytes} [Thu Mar 31 18:13:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:13:44.343298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf399e8-9425-4b28-b721-ff3e3df8ac9b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:44.368229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf399e8-9425-4b28-b721-ff3e3df8ac9b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:44.407360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917f9e1-9962-4805-a1e2-c08d3814357d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:44.407950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f9e1-9962-4805-a1e2-c08d3814357d service placement] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:44.408484 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f9e1-9962-4805-a1e2-c08d3814357d service placement] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:44.408922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f9e1-9962-4805-a1e2-c08d3814357d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:44.416521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c917f9e1-9962-4805-a1e2-c08d3814357d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:44.451465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917f9e1-9962-4805-a1e2-c08d3814357d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:44.454835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917f9e1-9962-4805-a1e2-c08d3814357d service placement] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:44.480079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191be02f-6190-4526-a108-fa18ed0f57de None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:44.493040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 823/1659] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:44.496807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:44.498066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:44.498587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:44.499103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] PATH_INFO: `/v3/users/20900a9623ab48da82bb3debc625ae83` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:44.502953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20900a9623ab48da82bb3debc625ae83)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:44.505705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:44.877391 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20900a9623ab48da82bb3debc625ae83'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:44.878119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20900a9623ab48da82bb3debc625ae83'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:44.903011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20900a9623ab48da82bb3debc625ae83'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:45.008919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20900a9623ab48da82bb3debc625ae83'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:45.017837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20900a9623ab48da82bb3debc625ae83'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:45.272500 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 837/1660] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:44 2022] DELETE /identity/v3/users/20900a9623ab48da82bb3debc625ae83 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:45.274378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:45.274378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:45.274378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:45.274378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:45.274378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:45.274378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 824/1661] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:13:45.328163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:45.328163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:45.328373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:45.328373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:45.347774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d45d-8375-46f7-a53b-94e5d19dbc43 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:45.355992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:45.357049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:45.357704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:45.358345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] PATH_INFO: `/v3/users/410abbe38edc4578bd0216ceb334ed5c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:45.361479 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410abbe38edc4578bd0216ceb334ed5c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:45.362862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: WARNING py.warnings [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:13:45.362862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: warnings.warn(msg) Mar 31 18:13:45.362862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: Mar 31 18:13:45.365077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:45.447162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fccf0-74c5-421b-8d61-54de941d3614 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:45.468900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233e09a-49b5-4232-a087-34888590802c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:45.471230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e09a-49b5-4232-a087-34888590802c service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:45.471519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e09a-49b5-4232-a087-34888590802c service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:45.471788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e09a-49b5-4232-a087-34888590802c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:45.500596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233e09a-49b5-4232-a087-34888590802c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:45.502842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233e09a-49b5-4232-a087-34888590802c service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:45.518760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 838/1662] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:45.731728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410abbe38edc4578bd0216ceb334ed5c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:45.857201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410abbe38edc4578bd0216ceb334ed5c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:45.908061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410abbe38edc4578bd0216ceb334ed5c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:45.929310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410abbe38edc4578bd0216ceb334ed5c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:45.943472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410abbe38edc4578bd0216ceb334ed5c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:46.009509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:46.010595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:46.011215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:46.013320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 825/1663] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:45 2022] DELETE /identity/v3/users/410abbe38edc4578bd0216ceb334ed5c => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:46.039784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:46.041092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:46.196465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 839/1664] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:46.242546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:46.245162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:46.369068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf9617-253d-4394-ac95-8cee697bf3e0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:46.374861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:46.375946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:46.376384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:46.376808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:46.390096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:46.392624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:46.405099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 826/1665] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:47.036009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:47.036009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:47.065990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11725b-0f53-473d-8afa-79a781e6da13 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:47.085523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:47.087304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:47.087590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:47.087952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] PATH_INFO: `/v3/projects/6fa6ff30a9664462a66a7b5f7d7a0231` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:47.094876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa6ff30a9664462a66a7b5f7d7a0231)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:47.095981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: WARNING py.warnings [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:13:47.095981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: warnings.warn(msg) Mar 31 18:13:47.095981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: Mar 31 18:13:47.097274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:47.232213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:47.234332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:47.287697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeddf6-3722-4bb6-8744-a40a88a4b5d4 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:47.301986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa6ff30a9664462a66a7b5f7d7a0231', 'request_id': 'req-47465960-03ee-4258-ab11-400190f61819'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.313300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa6ff30a9664462a66a7b5f7d7a0231', 'request_id': 'req-47465960-03ee-4258-ab11-400190f61819'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.390331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:47.391392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:47.391739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:47.392247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] PATH_INFO: `/v3/projects/360d519a088a46d99a916c1663406cef` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:47.394208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360d519a088a46d99a916c1663406cef)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:47.396195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:47.424316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa6ff30a9664462a66a7b5f7d7a0231', 'request_id': 'req-47465960-03ee-4258-ab11-400190f61819'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.465052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] The token cache is being invalidate because project 6fa6ff30a9664462a66a7b5f7d7a0231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:13:47.465580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.467109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.475790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 840/1666] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:13:47 2022] DELETE /identity/v3/projects/6fa6ff30a9664462a66a7b5f7d7a0231 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:47.481850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:47.482122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:47.522336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47465960-03ee-4258-ab11-400190f61819 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:47.523816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360d519a088a46d99a916c1663406cef', 'request_id': 'req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.613008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:47.614048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:47.614405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:47.614794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] PATH_INFO: `/v3/users/c96dcc79b6bc452ebac1fb3009ee0a73` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:47.616367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96dcc79b6bc452ebac1fb3009ee0a73)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:47.618708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:47.628233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360d519a088a46d99a916c1663406cef', 'request_id': 'req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.636712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360d519a088a46d99a916c1663406cef', 'request_id': 'req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.670152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] The token cache is being invalidate because project 360d519a088a46d99a916c1663406cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:13:47.670675 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.676786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.686803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 827/1667] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:13:47 2022] DELETE /identity/v3/projects/360d519a088a46d99a916c1663406cef => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:13:47.691182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:47.693515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:47.725081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8ea10-4d23-4946-94c1-1b05bc57e1d3 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:47.753451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:47.754898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:47.757554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:47.762725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] PATH_INFO: `/v3/users/3d8e59acdb084b5185e8f7dfab911bb5` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:47.765106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8e59acdb084b5185e8f7dfab911bb5)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:47.767426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:47.867758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96dcc79b6bc452ebac1fb3009ee0a73'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.872680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96dcc79b6bc452ebac1fb3009ee0a73'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:47.884844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96dcc79b6bc452ebac1fb3009ee0a73'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.000498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96dcc79b6bc452ebac1fb3009ee0a73'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.001154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96dcc79b6bc452ebac1fb3009ee0a73'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.037021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 841/1668] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:47 2022] DELETE /identity/v3/users/c96dcc79b6bc452ebac1fb3009ee0a73 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:48.066078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8e59acdb084b5185e8f7dfab911bb5'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.156504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8e59acdb084b5185e8f7dfab911bb5'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.205750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8e59acdb084b5185e8f7dfab911bb5'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.213095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8e59acdb084b5185e8f7dfab911bb5'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.216894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:48.218360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:48.229291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c3ddd673-70f9-430e-af5e-8bbd4055b110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8e59acdb084b5185e8f7dfab911bb5'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.308545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 828/1669] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:47 2022] DELETE /identity/v3/users/3d8e59acdb084b5185e8f7dfab911bb5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:13:48.458072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84350d24-0034-4d97-b0c1-cb898675017e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:48.588775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:48.589943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:48.590227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:48.591191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] PATH_INFO: `/v3/users/7fc41e54ee1a444ebb99229b6f161c0b` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:48.594169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc41e54ee1a444ebb99229b6f161c0b)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:48.596362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:48.862859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc41e54ee1a444ebb99229b6f161c0b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.864288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc41e54ee1a444ebb99229b6f161c0b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.876262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc41e54ee1a444ebb99229b6f161c0b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.977500 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc41e54ee1a444ebb99229b6f161c0b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:48.978219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc41e54ee1a444ebb99229b6f161c0b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:49.008056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 842/1670] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:48 2022] DELETE /identity/v3/users/7fc41e54ee1a444ebb99229b6f161c0b => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:13:49.014001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b54f-620c-496b-a764-4139809aee4d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:49.015002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b54f-620c-496b-a764-4139809aee4d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:49.016037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b54f-620c-496b-a764-4139809aee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:49.043185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c706b54f-620c-496b-a764-4139809aee4d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:49.045128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c706b54f-620c-496b-a764-4139809aee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:49.168200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 829/1671] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:49.192113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:49.194435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:49.387276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82c8d-a0a1-40f6-b067-b596e60719c8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:49.401096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:49.402732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:49.403296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:49.403791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:49.420727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:49.422814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:49.445884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 843/1672] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:49.747692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b54f-620c-496b-a764-4139809aee4d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:49.752433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c706b54f-620c-496b-a764-4139809aee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:49.789514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b54f-620c-496b-a764-4139809aee4d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:49.817726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:49.821605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:49.822973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:49.823424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:49.823980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] PATH_INFO: `/v3/projects/bf678a54583549fb81064cf0a9e5d0d7` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:49.824643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:49.829434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf678a54583549fb81064cf0a9e5d0d7)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:49.832151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:49.883935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98401035-b2e4-4e30-b3ea-4226572a46cd service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:49.899087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:49.900444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:49.900884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:49.901507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] PATH_INFO: `/v3/projects/460a719e905946b690e19a11f166933c` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:49.903796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460a719e905946b690e19a11f166933c)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:49.918580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:50.007215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf678a54583549fb81064cf0a9e5d0d7', 'request_id': 'req-e257e503-6db4-48ce-8625-4fc0b88477d1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.100815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460a719e905946b690e19a11f166933c', 'request_id': 'req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.112263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460a719e905946b690e19a11f166933c', 'request_id': 'req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.136606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf678a54583549fb81064cf0a9e5d0d7', 'request_id': 'req-e257e503-6db4-48ce-8625-4fc0b88477d1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.146131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf678a54583549fb81064cf0a9e5d0d7', 'request_id': 'req-e257e503-6db4-48ce-8625-4fc0b88477d1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.178394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] The token cache is being invalidate because project bf678a54583549fb81064cf0a9e5d0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:13:50.178905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.188493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e257e503-6db4-48ce-8625-4fc0b88477d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.188493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 830/1673] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:13:49 2022] DELETE /identity/v3/projects/bf678a54583549fb81064cf0a9e5d0d7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:50.197089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dea7d-3354-41f5-9f08-3e11154e3a5c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.197450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dea7d-3354-41f5-9f08-3e11154e3a5c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.198054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dea7d-3354-41f5-9f08-3e11154e3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.252422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0d3dea7d-3354-41f5-9f08-3e11154e3a5c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:50.253683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d3dea7d-3354-41f5-9f08-3e11154e3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:50.255822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460a719e905946b690e19a11f166933c', 'request_id': 'req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.280767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] The token cache is being invalidate because project 460a719e905946b690e19a11f166933c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:13:50.280993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.282576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cd48f895-28c0-4f1b-a9e3-fefc4f71fb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:50.287737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 844/1674] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:13:49 2022] DELETE /identity/v3/projects/460a719e905946b690e19a11f166933c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:13:50.295577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57d07-99d6-4791-9346-1d22aea846da None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.296187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57d07-99d6-4791-9346-1d22aea846da None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.296695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57d07-99d6-4791-9346-1d22aea846da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.347072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e2e57d07-99d6-4791-9346-1d22aea846da None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:50.348328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e2e57d07-99d6-4791-9346-1d22aea846da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:50.414382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 831/1675] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:50.422352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94621f-b565-49c0-aca1-8e7eaaafee49 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.422823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94621f-b565-49c0-aca1-8e7eaaafee49 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.423111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94621f-b565-49c0-aca1-8e7eaaafee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.488708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-de94621f-b565-49c0-aca1-8e7eaaafee49 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:50.493424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-de94621f-b565-49c0-aca1-8e7eaaafee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:50.538885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 832/1676] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:50.541046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94621f-b565-49c0-aca1-8e7eaaafee49 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:50.571110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94621f-b565-49c0-aca1-8e7eaaafee49 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:50.575045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:50.576953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.577949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.578347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.581389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:50.583802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:50.607737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 845/1677] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:50.613819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:50.618045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38087-abc3-4741-a049-659fdc6e121b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.622832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38087-abc3-4741-a049-659fdc6e121b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.622832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38087-abc3-4741-a049-659fdc6e121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.649738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 833/1678] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:50.654923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:50.662535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4da38087-abc3-4741-a049-659fdc6e121b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:50.664042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4da38087-abc3-4741-a049-659fdc6e121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:50.680842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 846/1679] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:13:50.682160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38087-abc3-4741-a049-659fdc6e121b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:50.686444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926e690-194e-4446-94e3-016b3997dbaa admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:50.694341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38087-abc3-4741-a049-659fdc6e121b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:50.700329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:50.701037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.701325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.701607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.702128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:50.702329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:50.703228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.703829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.704287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.705706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:50.706513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:50.706938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:50.708851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:50.732855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 847/1680] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:50.737358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:50.762242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f89ad-4bf3-410e-9974-22f2ffe63de1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:50.778594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:50.780256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:50.780768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:50.783052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:50.785448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:50.791367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:50.873060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 834/1681] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:50 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:13:50.878917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:50.984737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 848/1682] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:50 2022] POST /identity/v3/projects => generated 355 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:50.985982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:50.993382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.053855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511676f-89af-4043-8286-fc1b775a14c3 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.145620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247d40c-1379-4d7e-b89f-ebf9e5fbf263 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.151944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.153963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.160293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.160732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] PATH_INFO: `/v3/projects/d00c6a06c3384eb782d9d68ea83d7da2` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.162240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00c6a06c3384eb782d9d68ea83d7da2)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.164335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.168343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0ee48-ac51-4e63-81e0-d62a9cfa46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.169026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ee48-ac51-4e63-81e0-d62a9cfa46f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.169301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ee48-ac51-4e63-81e0-d62a9cfa46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.169567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ee48-ac51-4e63-81e0-d62a9cfa46f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.170258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0ee48-ac51-4e63-81e0-d62a9cfa46f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.172250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0ee48-ac51-4e63-81e0-d62a9cfa46f2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.301015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 835/1683] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:50 2022] POST /identity/v3/users => generated 291 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:51.301015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab954-68f3-4c95-80f2-a183bc4305a0 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.301283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab954-68f3-4c95-80f2-a183bc4305a0 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.301714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab954-68f3-4c95-80f2-a183bc4305a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.328105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00c6a06c3384eb782d9d68ea83d7da2', 'request_id': 'req-99fc7030-13b9-4030-8164-5c3f1944ba7d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.332255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-66aab954-68f3-4c95-80f2-a183bc4305a0 None None] MFA Rules not processed for user `d6a93e87d6894cfd9b7948274f1d7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:51.334793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-66aab954-68f3-4c95-80f2-a183bc4305a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.343739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00c6a06c3384eb782d9d68ea83d7da2', 'request_id': 'req-99fc7030-13b9-4030-8164-5c3f1944ba7d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.413022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 836/1684] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:51.413938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab954-68f3-4c95-80f2-a183bc4305a0 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:51.427683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00c6a06c3384eb782d9d68ea83d7da2', 'request_id': 'req-99fc7030-13b9-4030-8164-5c3f1944ba7d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.440323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] The token cache is being invalidate because project d00c6a06c3384eb782d9d68ea83d7da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:13:51.441845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.442899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-99fc7030-13b9-4030-8164-5c3f1944ba7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.446311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 849/1685] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:13:50 2022] DELETE /identity/v3/projects/d00c6a06c3384eb782d9d68ea83d7da2 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:51.446311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.446311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.446722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.476294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] MFA Rules not processed for user `b1092332ac6040c597d28a4207c1ce86`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:51.477555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.490989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab954-68f3-4c95-80f2-a183bc4305a0 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.497084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.497769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.498076 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.498378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.499120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.501032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.545363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 850/1686] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:51.546211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:51.547718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.563185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9bfc1-37c4-4492-8e51-a8b6b27b462e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.567443 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb90892-0be6-42ea-b036-bd3838e0bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.568105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90892-0be6-42ea-b036-bd3838e0bb38 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.568388 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90892-0be6-42ea-b036-bd3838e0bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.568693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90892-0be6-42ea-b036-bd3838e0bb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.569463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb90892-0be6-42ea-b036-bd3838e0bb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.571422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb90892-0be6-42ea-b036-bd3838e0bb38 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.585865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 851/1687] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:51.585865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.585865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.585865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.595016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 837/1688] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:51 2022] POST /identity/v3/users => generated 278 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:51.595881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:51.599124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.614871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d4ca-df73-4b8c-adb6-779b2273584e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.619609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] MFA Rules not processed for user `d6a93e87d6894cfd9b7948274f1d7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:51.620893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.621696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.622248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.622591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.622929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] PATH_INFO: `/v3/users/ef38f04e415348bd8c33d388f53c1b43` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.624175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef38f04e415348bd8c33d388f53c1b43)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.626226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.635223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 852/1689] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:51.635223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:51.638675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.761735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2dda6-7bed-4f5b-a9e5-71df0ba37979 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.767754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.768406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.768681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.768950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.779296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.780869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.793153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 853/1690] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:51.794000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:51.805385 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fc246-6b40-4ac0-a07e-57f56fa9abf0 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.812070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.812831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.813193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.813537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.814433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.816264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.830189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 854/1691] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:51.834786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:51.837399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.873955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5789dd-095f-46e0-874f-88d993af6728 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.880650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef38f04e415348bd8c33d388f53c1b43'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.882972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:51.885163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:51.885644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:51.886933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:51.888789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:51.890595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:51.905739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 855/1692] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:51.905739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:51.909262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:51.958520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9616e7-4a12-4628-ad9a-167ca7d28b31 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:51.981272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef38f04e415348bd8c33d388f53c1b43'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.997445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef38f04e415348bd8c33d388f53c1b43'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.998455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef38f04e415348bd8c33d388f53c1b43'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:51.999271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef38f04e415348bd8c33d388f53c1b43'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:52.022845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:52.023665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:52.024081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 838/1693] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:51 2022] DELETE /identity/v3/users/ef38f04e415348bd8c33d388f53c1b43 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:52.024319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:52.024652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:52.025842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:52.027636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:52.035068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:52.067187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:52.069396 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:52.088632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 856/1694] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:52.105392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:52.108111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:52.141724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bdb92-59c6-49ef-981c-4983a5de542d service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:52.207932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c1ec-1a3a-4679-ba18-d66dca30af72 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:52.215237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19659d2f-e078-40da-923d-10b5c890c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:52.216419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19659d2f-e078-40da-923d-10b5c890c641 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:52.216900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19659d2f-e078-40da-923d-10b5c890c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:52.217482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19659d2f-e078-40da-923d-10b5c890c641 admin admin] PATH_INFO: `/v3/projects/1f7e93e38e06412fa948d40608635947/users/b7ba947807f04e6baa55b6ac479b3ddd/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:52.239460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19659d2f-e078-40da-923d-10b5c890c641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7e93e38e06412fa948d40608635947, user_id=b7ba947807f04e6baa55b6ac479b3ddd, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:52.246310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19659d2f-e078-40da-923d-10b5c890c641 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:52.310174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:52.311375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:52.311725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:52.312210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:52.319736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:52.319736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:52.339458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 857/1695] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:52.345494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:52.366543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2b56-da8b-4061-b744-45febd6d96fe admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:52.377795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741f1e8-a421-44dc-8570-b49a479eb3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:52.378994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741f1e8-a421-44dc-8570-b49a479eb3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:52.379426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741f1e8-a421-44dc-8570-b49a479eb3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:52.379878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741f1e8-a421-44dc-8570-b49a479eb3f0 admin admin] PATH_INFO: `/v3/projects/4bb3fcb9d485410bb2fe66c7262301b0/users/e3ac39da183d430caf03fc4bc40351b8/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:52.397024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 839/1696] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:52 2022] PUT /identity/v3/projects/1f7e93e38e06412fa948d40608635947/users/b7ba947807f04e6baa55b6ac479b3ddd/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:52.410252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8ac2-4f70-4901-b31b-cd165ec8360f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:52.410549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8ac2-4f70-4901-b31b-cd165ec8360f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:52.410854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8ac2-4f70-4901-b31b-cd165ec8360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:52.417046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741f1e8-a421-44dc-8570-b49a479eb3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb3fcb9d485410bb2fe66c7262301b0, user_id=e3ac39da183d430caf03fc4bc40351b8, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:52.424818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741f1e8-a421-44dc-8570-b49a479eb3f0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:52.507650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7e0e8ac2-4f70-4901-b31b-cd165ec8360f None None] MFA Rules not processed for user `b7ba947807f04e6baa55b6ac479b3ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:52.508911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7e0e8ac2-4f70-4901-b31b-cd165ec8360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:52.631232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 858/1697] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:52 2022] PUT /identity/v3/projects/4bb3fcb9d485410bb2fe66c7262301b0/users/e3ac39da183d430caf03fc4bc40351b8/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:52.644861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855ed9-8055-461c-80ed-be30b7e10766 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:52.645169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855ed9-8055-461c-80ed-be30b7e10766 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:52.646051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855ed9-8055-461c-80ed-be30b7e10766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:52.695568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 840/1698] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:52.710168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8ac2-4f70-4901-b31b-cd165ec8360f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:52.731950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-67855ed9-8055-461c-80ed-be30b7e10766 None None] MFA Rules not processed for user `e3ac39da183d430caf03fc4bc40351b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:52.733175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-67855ed9-8055-461c-80ed-be30b7e10766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:52.882323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 859/1699] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:52 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:52.884698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855ed9-8055-461c-80ed-be30b7e10766 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:52.900425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8ac2-4f70-4901-b31b-cd165ec8360f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:53.015955 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:53.016801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:53.017458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:53.017843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:53.018821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:53.027238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:53.149446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855ed9-8055-461c-80ed-be30b7e10766 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:53.163551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:53.166592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:53.166592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:53.166592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:53.166592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:53.168811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:53.182430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 841/1700] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:52 2022] POST /identity/v3/projects => generated 381 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:13:53.183712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:53.187485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:53.351450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b2885-19b1-458c-b6e4-6638e4e0469b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:53.363823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 860/1701] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:52 2022] POST /identity/v3/projects => generated 355 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:53.365174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:53.383863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:53.387095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:53.388043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:53.388435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] PATH_INFO: `/v3/users/9d94abd38a5f440c9fa68ef9cd67604b` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:53.390293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d94abd38a5f440c9fa68ef9cd67604b)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:53.393629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:53.547034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec515d-862b-4127-970e-eda6c8564956 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:53.553870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:53.555012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:53.555452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:53.555722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:53.556568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:53.559424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:53.665709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d94abd38a5f440c9fa68ef9cd67604b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:53.681488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 861/1702] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:53 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:53.683330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:53.688934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:53.717125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba131b-24ff-4718-9846-e3b273e22203 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:53.743801 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:53.744819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:53.745261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:53.746453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] PATH_INFO: `/v3/projects/87ee5311fdca44299a05295c7364afd2` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:53.749167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ee5311fdca44299a05295c7364afd2)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:53.753675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:53.763970 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d94abd38a5f440c9fa68ef9cd67604b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:53.793323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d94abd38a5f440c9fa68ef9cd67604b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:53.795387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d94abd38a5f440c9fa68ef9cd67604b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:53.796346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d94abd38a5f440c9fa68ef9cd67604b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:53.842768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 842/1703] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:53 2022] DELETE /identity/v3/users/9d94abd38a5f440c9fa68ef9cd67604b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:53.852563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:53.852563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:53.981310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ee5311fdca44299a05295c7364afd2', 'request_id': 'req-749bb966-b018-47fb-b020-a8e47bcb6cab'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:54.007729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ee5311fdca44299a05295c7364afd2', 'request_id': 'req-749bb966-b018-47fb-b020-a8e47bcb6cab'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:54.016917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71eda6-2b08-46d8-958a-f35da7d594f2 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:54.108230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ee5311fdca44299a05295c7364afd2', 'request_id': 'req-749bb966-b018-47fb-b020-a8e47bcb6cab'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:54.126301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] The token cache is being invalidate because project 87ee5311fdca44299a05295c7364afd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:13:54.126964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:54.128109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:54.130896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf652b-7f8b-4a26-ba05-03313c0e5d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:54.132049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf652b-7f8b-4a26-ba05-03313c0e5d10 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.132344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf652b-7f8b-4a26-ba05-03313c0e5d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.132621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf652b-7f8b-4a26-ba05-03313c0e5d10 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.136297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf652b-7f8b-4a26-ba05-03313c0e5d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:54.142683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf652b-7f8b-4a26-ba05-03313c0e5d10 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:54.144600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 862/1704] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:13:53 2022] DELETE /identity/v3/projects/87ee5311fdca44299a05295c7364afd2 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:54.150813 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:54.169241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.208386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bb966-b018-47fb-b020-a8e47bcb6cab admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:54.217436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c5349-8793-40f0-9d38-78185656c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:54.218081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5349-8793-40f0-9d38-78185656c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.218393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5349-8793-40f0-9d38-78185656c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.218639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5349-8793-40f0-9d38-78185656c6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.220009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c5349-8793-40f0-9d38-78185656c6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:54.223127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c5349-8793-40f0-9d38-78185656c6ec admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:54.235537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 863/1705] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:54.240255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68511-f80c-473f-8b3e-2033839e4377 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.240590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68511-f80c-473f-8b3e-2033839e4377 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.240877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68511-f80c-473f-8b3e-2033839e4377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.263863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f8d68511-f80c-473f-8b3e-2033839e4377 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:54.266157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f8d68511-f80c-473f-8b3e-2033839e4377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.275227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 864/1706] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:54.284541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.291154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 843/1707] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:53 2022] POST /identity/v3/users => generated 284 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:54.291154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068928-a682-4fc5-bc58-1a2501876615 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.291154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068928-a682-4fc5-bc58-1a2501876615 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.291954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068928-a682-4fc5-bc58-1a2501876615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.292155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.292888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.340147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] MFA Rules not processed for user `d6a93e87d6894cfd9b7948274f1d7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:54.341747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.345372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f9068928-a682-4fc5-bc58-1a2501876615 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:54.352249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f9068928-a682-4fc5-bc58-1a2501876615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.371043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 844/1708] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:54.371777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9068928-a682-4fc5-bc58-1a2501876615 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:54.399677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9068928-a682-4fc5-bc58-1a2501876615 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:54.408181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:54.409570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.410044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.410487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] PATH_INFO: `/v3/projects/9a20017665e949658394f870360e6b35/users/65aef20587014309b7baebc008ce0e15/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.453348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a20017665e949658394f870360e6b35, user_id=65aef20587014309b7baebc008ce0e15, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:54.456363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:54.485563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 865/1709] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:54.487308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:54.488990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.538256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 845/1710] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:54 2022] PUT /identity/v3/projects/9a20017665e949658394f870360e6b35/users/65aef20587014309b7baebc008ce0e15/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:54.539102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:54.541948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f44c9f-f278-4a16-9443-a2761b356837 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:54.545419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.695685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885f593-949f-4242-9fe1-265581ac406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:54.696382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f593-949f-4242-9fe1-265581ac406e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.696667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f593-949f-4242-9fe1-265581ac406e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.696946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f593-949f-4242-9fe1-265581ac406e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.697764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885f593-949f-4242-9fe1-265581ac406e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:54.699697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885f593-949f-4242-9fe1-265581ac406e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:54.708030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906528b-12fa-4eb3-8feb-67c0167dc0c9 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:54.716148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:54.717025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.717312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.717645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.728251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 866/1711] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:54.730200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:54.730510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd3d1-2e12-4700-9100-dd6d9df3aa45 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.730834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd3d1-2e12-4700-9100-dd6d9df3aa45 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.731115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd3d1-2e12-4700-9100-dd6d9df3aa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.732269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:54.747892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 846/1712] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:54.749036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:54.763302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deae1bd-52e9-4332-9d3c-411a0292697a service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:54.770992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d6dc3-b595-4691-badb-b5f87ad4e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:54.771920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6dc3-b595-4691-badb-b5f87ad4e0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.772224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6dc3-b595-4691-badb-b5f87ad4e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.772510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6dc3-b595-4691-badb-b5f87ad4e0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.780036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d6dc3-b595-4691-badb-b5f87ad4e0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:54.780036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d6dc3-b595-4691-badb-b5f87ad4e0f5 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:54.788716 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2dcfd3d1-2e12-4700-9100-dd6d9df3aa45 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:54.790000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2dcfd3d1-2e12-4700-9100-dd6d9df3aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.795839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 847/1713] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:54.797922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34849c59-acb5-4762-8c1d-d89a19edc33d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.798498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34849c59-acb5-4762-8c1d-d89a19edc33d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.798825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34849c59-acb5-4762-8c1d-d89a19edc33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.830523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 867/1714] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:54.831422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd3d1-2e12-4700-9100-dd6d9df3aa45 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:54.832894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-34849c59-acb5-4762-8c1d-d89a19edc33d None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:54.839110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-34849c59-acb5-4762-8c1d-d89a19edc33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:54.847563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd3d1-2e12-4700-9100-dd6d9df3aa45 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:54.862920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:54.863906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:54.864189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:54.864467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] PATH_INFO: `/v3/projects/3b2cd0d27ec84af387e537c7a6f67820/users/90875f57f6bb458da19b26e0ae994057/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:54.922971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2cd0d27ec84af387e537c7a6f67820, user_id=90875f57f6bb458da19b26e0ae994057, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:54.925990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:55.007192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 848/1715] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:55.007192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34849c59-acb5-4762-8c1d-d89a19edc33d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.013822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 868/1716] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:54 2022] PUT /identity/v3/projects/3b2cd0d27ec84af387e537c7a6f67820/users/90875f57f6bb458da19b26e0ae994057/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:55.019144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.065891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34849c59-acb5-4762-8c1d-d89a19edc33d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:55.239314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4f32-606b-454b-9dd0-4d9fb00990a5 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:55.242408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:55.245638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:55.246352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:55.247842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] PATH_INFO: `/v3/projects/9a20017665e949658394f870360e6b35/users/65aef20587014309b7baebc008ce0e15/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:55.252276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:55.253008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:55.254363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a20017665e949658394f870360e6b35, user_id=65aef20587014309b7baebc008ce0e15, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:55.256319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:55.256685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:55.260794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:55.260794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:55.260794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:55.264215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:55.287791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 869/1717] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:55.292249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 849/1718] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:54 2022] PUT /identity/v3/projects/9a20017665e949658394f870360e6b35/users/65aef20587014309b7baebc008ce0e15/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:55.292414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.293597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.321687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8da913-2920-4b21-8b17-45af35a64ef8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:55.429165 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ca7f-7b5e-4456-a477-7df5d9adcb3e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:55.448761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:55.449945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:55.452364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:55.452364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:55.452364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:55.452579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b09e-72c3-4472-a128-9eb2aede6100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:55.453157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:55.453499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b09e-72c3-4472-a128-9eb2aede6100 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:55.453880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b09e-72c3-4472-a128-9eb2aede6100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:55.454170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b09e-72c3-4472-a128-9eb2aede6100 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:55.454998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716b09e-72c3-4472-a128-9eb2aede6100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:55.460463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716b09e-72c3-4472-a128-9eb2aede6100 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:55.479481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 870/1719] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:55.481431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a558-5757-4027-9f3f-4d87b0e59122 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:55.481877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a558-5757-4027-9f3f-4d87b0e59122 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:55.482457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4a558-5757-4027-9f3f-4d87b0e59122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:55.544463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1cc4a558-5757-4027-9f3f-4d87b0e59122 None None] MFA Rules not processed for user `65aef20587014309b7baebc008ce0e15`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:55.545813 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1cc4a558-5757-4027-9f3f-4d87b0e59122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:55.653154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 850/1720] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:55 2022] POST /identity/v3/projects => generated 407 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:55.657716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.750917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 871/1721] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:55.751639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a558-5757-4027-9f3f-4d87b0e59122 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.798025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4a558-5757-4027-9f3f-4d87b0e59122 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:55.821496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:55.822799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:55.823102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:55.823378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:55.824085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:55.826067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:55.834472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f0a7d-ce7f-4532-b598-7958a85e5d34 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:55.844575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:55.846407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:55.846753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:55.847038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] PATH_INFO: `/v3/projects/3b2cd0d27ec84af387e537c7a6f67820/users/90875f57f6bb458da19b26e0ae994057/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:55.851224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2cd0d27ec84af387e537c7a6f67820, user_id=90875f57f6bb458da19b26e0ae994057, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:55.855429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:55.898564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 851/1722] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:55 2022] PUT /identity/v3/projects/3b2cd0d27ec84af387e537c7a6f67820/users/90875f57f6bb458da19b26e0ae994057/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:55.898564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.898564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:55.975784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 872/1723] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:55 2022] POST /identity/v3/users => generated 304 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:55.976678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:55.984124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:56.087453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd769a1c-9072-4f56-aab7-167d9fb80407 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:56.114534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6765d-a064-4c29-ab5e-4c44157b4f01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:56.117870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6765d-a064-4c29-ab5e-4c44157b4f01 service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.118166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6765d-a064-4c29-ab5e-4c44157b4f01 service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.118445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6765d-a064-4c29-ab5e-4c44157b4f01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.136831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102b584-7348-489f-87aa-defe83ea960c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:56.241464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:56.242252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.242513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.242821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.295131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6765d-a064-4c29-ab5e-4c44157b4f01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:56.301161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6765d-a064-4c29-ab5e-4c44157b4f01 service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:56.312854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 852/1724] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:13:56.323401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.323693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.323973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.392389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:56.394090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:56.405413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] MFA Rules not processed for user `90875f57f6bb458da19b26e0ae994057`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:56.406865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:56.430841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 873/1725] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:56.440762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:56.626996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 853/1726] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:56 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:56.628752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:56.635418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:56.659963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd111af-8a7c-4a0c-9f47-d4f543224649 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:56.675456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:56.803607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.803607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.803607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.804434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df373d2-bd6d-4ec0-aed1-c04c8593f728 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:56.804525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:56.804525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:56.804697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:56.804697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.804697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.804697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] PATH_INFO: `/v3/users/5ad0aaae50bd426086290e36288c5312` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.805000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad0aaae50bd426086290e36288c5312)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:56.805000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:56.805147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 874/1727] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:56.805147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:56.805147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599eeb80-eefe-432b-97f1-98bb90222350 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:56.805147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:56.805465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.805465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.805465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.805465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:56.805465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:56.805465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 875/1728] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:56 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:56.805906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:56.805906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55795f1-3422-4e65-b211-1ca5b93e3a5e service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:56.816781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:56.817466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.817892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.828888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.840178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:56.845350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:56.876044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 876/1729] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:56.876044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:56.907917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d183f-1f27-4d2c-b533-4a906c8b8d89 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:56.923502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdd42c-3561-48f5-8d05-346d8fd811a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:56.924564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd42c-3561-48f5-8d05-346d8fd811a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:56.924851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd42c-3561-48f5-8d05-346d8fd811a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:56.925125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd42c-3561-48f5-8d05-346d8fd811a4 admin admin] PATH_INFO: `/v3/projects/3e74a0c6abfc43ecae35946fbe91cbe8/users/6d4c15b126d34355a4046288452a2b2e/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:56.962059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdd42c-3561-48f5-8d05-346d8fd811a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e74a0c6abfc43ecae35946fbe91cbe8, user_id=6d4c15b126d34355a4046288452a2b2e, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:56.964262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdd42c-3561-48f5-8d05-346d8fd811a4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:57.177654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 877/1730] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:56 2022] PUT /identity/v3/projects/3e74a0c6abfc43ecae35946fbe91cbe8/users/6d4c15b126d34355a4046288452a2b2e/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:57.181880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:57.182765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:57.183936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:57.201116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad0aaae50bd426086290e36288c5312'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:57.274233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] MFA Rules not processed for user `6d4c15b126d34355a4046288452a2b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:57.275973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:57.387555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad0aaae50bd426086290e36288c5312'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:57.427977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad0aaae50bd426086290e36288c5312'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:57.430002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad0aaae50bd426086290e36288c5312'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:57.430989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad0aaae50bd426086290e36288c5312'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:57.458414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 878/1731] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:57.460571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:57.471078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:57.488247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 854/1732] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:13:56 2022] DELETE /identity/v3/users/5ad0aaae50bd426086290e36288c5312 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:57.496795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:57.509381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:57.593629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d851-9095-4b16-87b0-b69d6078bb18 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:57.701480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99a34-a838-47f4-9555-0188ce4057f2 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:57.705387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:57.706069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:57.706523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:57.706675 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:57.716294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:57.730266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:57.730266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:57.730266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:57.730266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] PATH_INFO: `/v3/projects/02ed38429c7a482d9b048c869783abf6` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:57.731135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ed38429c7a482d9b048c869783abf6)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:57.731135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:57.864271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:57.865847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:57.910022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 855/1733] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:57 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:57.911133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:57.916323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:57.937755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ed38429c7a482d9b048c869783abf6', 'request_id': 'req-7f1ca3e7-141d-4d48-b1ea-194338298da4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:57.950986 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c41b7-78a5-4c73-ab3a-31be92c2addd service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:57.970894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ed38429c7a482d9b048c869783abf6', 'request_id': 'req-7f1ca3e7-141d-4d48-b1ea-194338298da4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:58.076799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ed38429c7a482d9b048c869783abf6', 'request_id': 'req-7f1ca3e7-141d-4d48-b1ea-194338298da4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:58.101703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] The token cache is being invalidate because project 02ed38429c7a482d9b048c869783abf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:13:58.114722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:58.117303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7f1ca3e7-141d-4d48-b1ea-194338298da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:13:58.125545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 879/1734] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:13:57 2022] DELETE /identity/v3/projects/02ed38429c7a482d9b048c869783abf6 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:58.129149 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661784b-e857-4926-aa34-35d75b9e0a18 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.129497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661784b-e857-4926-aa34-35d75b9e0a18 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.129956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661784b-e857-4926-aa34-35d75b9e0a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.154760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0661784b-e857-4926-aa34-35d75b9e0a18 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:58.156271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0661784b-e857-4926-aa34-35d75b9e0a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.158907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:58.160020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.160312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.160819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.161826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:58.164709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:58.171265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 880/1735] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:58.173120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871568d-cddc-4f94-b3ff-32265bbec34b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.173405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871568d-cddc-4f94-b3ff-32265bbec34b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.173681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871568d-cddc-4f94-b3ff-32265bbec34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.197602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d871568d-cddc-4f94-b3ff-32265bbec34b None None] MFA Rules not processed for user `7436a3068f6545a4b74c877c5b8c81c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:58.199566 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d871568d-cddc-4f94-b3ff-32265bbec34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.298699 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 881/1736] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Mar 31 18:13:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:58.300532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.300953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.301278 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.319523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 856/1737] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:57 2022] POST /identity/v3/projects => generated 407 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:58.319523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:58.322759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.341272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:58.345094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.468408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f301d5d-acd6-4afb-a6e9-bed70a248262 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:58.478823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:58.504920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.505269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.505572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.529224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 882/1738] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:58.530085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:58.534551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.564620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f1ae0-ca7b-46ec-b542-15c8dcc22b73 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:58.569906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:58.569906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:58.583355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe48ba0-bb95-47fd-a7ba-c4af85c2e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:58.584070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48ba0-bb95-47fd-a7ba-c4af85c2e882 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.584340 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48ba0-bb95-47fd-a7ba-c4af85c2e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.584616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48ba0-bb95-47fd-a7ba-c4af85c2e882 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.585337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe48ba0-bb95-47fd-a7ba-c4af85c2e882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:58.587454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe48ba0-bb95-47fd-a7ba-c4af85c2e882 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:58.633943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 857/1739] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:58.635540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:58.636932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.665120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc3a9-34d0-496e-9b36-863528e93ebb service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:58.683211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:58.684505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.684805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.685136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.697209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:58.709296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:58.724165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 883/1740] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:58 2022] POST /identity/v3/users => generated 310 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:58.725857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7a765-d9be-4b39-9ca9-01f655893c62 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.726146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7a765-d9be-4b39-9ca9-01f655893c62 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.726425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7a765-d9be-4b39-9ca9-01f655893c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.759748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 858/1741] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:13:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:13:58.764032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:58.767900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.808276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-3ac7a765-d9be-4b39-9ca9-01f655893c62 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:58.823578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3ac7a765-d9be-4b39-9ca9-01f655893c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:58.845395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 884/1742] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:13:58.847663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7a765-d9be-4b39-9ca9-01f655893c62 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:58.873958 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7a765-d9be-4b39-9ca9-01f655893c62 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:58.888543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:58.891347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.892680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.893768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.896134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:58.901091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:58.929748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 885/1743] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:58.930809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:58.934389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59428-747d-443c-b03d-7b622e973551 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:58.947069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65aef20587014309b7baebc008ce0e15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a20017665e949658394f870360e6b35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:58.948162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.948555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.949386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.950451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:58.952326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:58.954340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:58.958515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736eb2a-1ef2-49ee-93f3-65c928f59a84 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:58.972521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:58.973346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:58.973724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:58.974098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:58.975240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:58.975509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:58.980048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:58.994954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 859/1744] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:58.996287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:59.013064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 886/1745] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:59.013064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:59.025121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb48e4-7f87-42d5-94a5-5fc41a2ccb63 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:59.033010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:59.034110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.034461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.034830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] PATH_INFO: `/v3/projects/5efe8d9fb9b548f0a6d1bd46af75f6d4/users/5e89d82f9735418caa0148d58b869e45/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.039368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c9ea1-d0d9-425e-806b-1c3649025ec4 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:59.043546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65aef20587014309b7baebc008ce0e15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a20017665e949658394f870360e6b35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:59.044435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.044967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.045395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.046485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:59.049725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:59.065847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efe8d9fb9b548f0a6d1bd46af75f6d4, user_id=5e89d82f9735418caa0148d58b869e45, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:59.069617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:59.172300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 887/1746] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:59 2022] POST /identity/v3/projects => generated 354 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:59.173342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:59.205748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 860/1747] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:58 2022] PUT /identity/v3/projects/5efe8d9fb9b548f0a6d1bd46af75f6d4/users/5e89d82f9735418caa0148d58b869e45/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:59.207836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:59.363159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20de94-5ae5-4148-a378-9e3a848ee80d tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:59.386216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:59.386997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.390930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.391386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.394358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:59.396401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:59.470527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928cfff-ebac-4cc5-8ce6-ed23cd2124ee admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:59.542511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 888/1748] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:13:59 2022] POST /identity/v3/projects => generated 373 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:13:59.545634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:59.615084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65aef20587014309b7baebc008ce0e15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a20017665e949658394f870360e6b35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:59.619174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.619613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.622357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.623672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:13:59.625016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:59.647683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:59.716203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ac175-f19c-4871-8554-56f8ac63e0bc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:59.722292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:59.723345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.724216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.724781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.726310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:59.728210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:59.730131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 861/1749] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:13:59.734197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:59.750939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 889/1750] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:13:59.755448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:13:59.772166 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b369b7-edbf-409c-a3f3-ff8478141393 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:59.780081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e722a8-3ddd-4d60-92e3-30b77e365823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:59.781195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e722a8-3ddd-4d60-92e3-30b77e365823 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.781549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e722a8-3ddd-4d60-92e3-30b77e365823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.781915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e722a8-3ddd-4d60-92e3-30b77e365823 admin admin] PATH_INFO: `/v3/projects/5efe8d9fb9b548f0a6d1bd46af75f6d4/users/5e89d82f9735418caa0148d58b869e45/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.784317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e722a8-3ddd-4d60-92e3-30b77e365823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efe8d9fb9b548f0a6d1bd46af75f6d4, user_id=5e89d82f9735418caa0148d58b869e45, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:59.787111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e722a8-3ddd-4d60-92e3-30b77e365823 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:13:59.788400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0718061-b68a-4ad7-bbcc-dff59b708ac3 tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:13:59.801056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 890/1751] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:13:59 2022] PUT /identity/v3/projects/5efe8d9fb9b548f0a6d1bd46af75f6d4/users/5e89d82f9735418caa0148d58b869e45/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:13:59.814737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2811b48-4cc5-4bed-928e-344dbdff79a8 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.815682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2811b48-4cc5-4bed-928e-344dbdff79a8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.815682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2811b48-4cc5-4bed-928e-344dbdff79a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.864640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e2811b48-4cc5-4bed-928e-344dbdff79a8 None None] MFA Rules not processed for user `5e89d82f9735418caa0148d58b869e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:13:59.865898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e2811b48-4cc5-4bed-928e-344dbdff79a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:13:59.951463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c8c5d-79a9-4920-9d96-e937243ebbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:13:59.952230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c8c5d-79a9-4920-9d96-e937243ebbcf admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:13:59.963275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c8c5d-79a9-4920-9d96-e937243ebbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:13:59.963679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c8c5d-79a9-4920-9d96-e937243ebbcf admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:13:59.964450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c8c5d-79a9-4920-9d96-e937243ebbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:13:59.968928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c8c5d-79a9-4920-9d96-e937243ebbcf admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:00.008912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 891/1752] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:13:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:00.009530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2811b48-4cc5-4bed-928e-344dbdff79a8 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:00.104514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 862/1753] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:13:59 2022] POST /identity/v3/users => generated 287 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:00.107398 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:00.108999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:00.110435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:00.170103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] MFA Rules not processed for user `b1092332ac6040c597d28a4207c1ce86`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:00.175330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:00.215481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2811b48-4cc5-4bed-928e-344dbdff79a8 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:00.243438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65aef20587014309b7baebc008ce0e15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a20017665e949658394f870360e6b35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:00.244348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:00.251119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:00.251119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] PATH_INFO: `/v3/projects/bca286e8ba8d46aaa0aba272fd79b336` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:00.251119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bca286e8ba8d46aaa0aba272fd79b336)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:00.251558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:00.313070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 863/1754] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:00.314910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:00.322022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:00.485209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e63b7-4166-4ba3-adcb-ee3981ebb785 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:00.502599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:00.503323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:00.503607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:00.503882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:00.527841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:00.529307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:00.555135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 864/1755] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:00 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:00.559260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:00.597775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59739c5c-0502-4933-8503-3384fa9aea6e service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:00.606374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:00.607116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:00.614766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:00.615345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:00.616221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:00.617770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:00.642960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 865/1756] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:00.643909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:00.688818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251521d-eb87-47b4-ba04-1a90e6c7834c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:00.713515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:00.714226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:00.714649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:00.714781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:00.715523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:00.717797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:00.743467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 866/1757] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:00.753679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:00.771484 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2182-76a0-4be7-900d-754ce7a16498 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:00.786847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3752587-bca8-498b-9b37-9b3419d629e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:00.789344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752587-bca8-498b-9b37-9b3419d629e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:00.789344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752587-bca8-498b-9b37-9b3419d629e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:00.789344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752587-bca8-498b-9b37-9b3419d629e2 admin admin] PATH_INFO: `/v3/projects/62979a968dd14c99815af4d5fd3663ed/users/b8a2f15deb88420ab56c0765812e65b6/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:00.820271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca286e8ba8d46aaa0aba272fd79b336', 'request_id': 'req-e894e37e-3072-47b9-bde0-f8a3fdefe6af'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:00.836206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca286e8ba8d46aaa0aba272fd79b336', 'request_id': 'req-e894e37e-3072-47b9-bde0-f8a3fdefe6af'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:00.846057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3752587-bca8-498b-9b37-9b3419d629e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62979a968dd14c99815af4d5fd3663ed, user_id=b8a2f15deb88420ab56c0765812e65b6, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:00.847301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3752587-bca8-498b-9b37-9b3419d629e2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:01.223013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca286e8ba8d46aaa0aba272fd79b336', 'request_id': 'req-e894e37e-3072-47b9-bde0-f8a3fdefe6af'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:01.237336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 867/1758] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:00 2022] PUT /identity/v3/projects/62979a968dd14c99815af4d5fd3663ed/users/b8a2f15deb88420ab56c0765812e65b6/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:01.246339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] The token cache is being invalidate because project bca286e8ba8d46aaa0aba272fd79b336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:01.246956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:01.248853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:01.249302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:01.249711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:01.256732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:01.274007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 892/1759] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:00 2022] DELETE /identity/v3/projects/bca286e8ba8d46aaa0aba272fd79b336 => generated 0 bytes in 1265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:01.281621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:01.286583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:01.344955 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] MFA Rules not processed for user `b8a2f15deb88420ab56c0765812e65b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:01.346202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:01.474881 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e37e-3072-47b9-bde0-f8a3fdefe6af tempest-VolumeQuotaClassesTest-1631054588 tempest-VolumeQuotaClassesTest-1631054588-project-admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:01.562181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 868/1760] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:01.635520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:01.636726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:01.637183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:01.637417 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] PATH_INFO: `/v3/projects/12eaab25037841428a6ba39920b72361` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:01.639341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12eaab25037841428a6ba39920b72361)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:01.641290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:01.697525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:01.699732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:01.867402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fcc7-0b5c-4cdd-ba85-0cb99200614c None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:01.885613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12eaab25037841428a6ba39920b72361', 'request_id': 'req-dd998c81-5e48-4161-ba25-5e0f1a334273'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:01.903264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12eaab25037841428a6ba39920b72361', 'request_id': 'req-dd998c81-5e48-4161-ba25-5e0f1a334273'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:01.955429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acaac4-cbe4-4ceb-a670-2b5083c68bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:01.956353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acaac4-cbe4-4ceb-a670-2b5083c68bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:01.962244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acaac4-cbe4-4ceb-a670-2b5083c68bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:01.962244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acaac4-cbe4-4ceb-a670-2b5083c68bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:01.962244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-01acaac4-cbe4-4ceb-a670-2b5083c68bf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:02.072983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12eaab25037841428a6ba39920b72361', 'request_id': 'req-dd998c81-5e48-4161-ba25-5e0f1a334273'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:02.094157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] The token cache is being invalidate because project 12eaab25037841428a6ba39920b72361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:02.095430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:02.097631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:02.108575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 893/1761] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:01 2022] DELETE /identity/v3/projects/12eaab25037841428a6ba39920b72361 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:02.108575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:02.114596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:02.303855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acaac4-cbe4-4ceb-a670-2b5083c68bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:02.307466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acaac4-cbe4-4ceb-a670-2b5083c68bf5 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:02.342687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 869/1762] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:02.347244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a5500-54db-44ff-97fe-bb1a89e59693 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:02.351716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a5500-54db-44ff-97fe-bb1a89e59693 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:02.353005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a5500-54db-44ff-97fe-bb1a89e59693 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:02.376034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 870/1763] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:14:02 2022] GET /identity => generated 270 bytes in 32 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:14:02.381270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b583-bde8-43a7-b116-5b92222d3edd None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:02.381721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b583-bde8-43a7-b116-5b92222d3edd None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:02.384535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b583-bde8-43a7-b116-5b92222d3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:02.461413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d446b583-bde8-43a7-b116-5b92222d3edd None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:02.469295 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d446b583-bde8-43a7-b116-5b92222d3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:02.550653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd998c81-5e48-4161-ba25-5e0f1a334273 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:02.567075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:02.573859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:02.574276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:02.574855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:02.581767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:02.670442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 871/1764] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:02.674885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf27f3-5443-42a0-94e7-a72326f66eed None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:02.682492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf27f3-5443-42a0-94e7-a72326f66eed None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:02.683101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf27f3-5443-42a0-94e7-a72326f66eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:02.730518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-11bf27f3-5443-42a0-94e7-a72326f66eed None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:02.734870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-11bf27f3-5443-42a0-94e7-a72326f66eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:02.741008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:02.744223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:02.763711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 872/1765] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:02.765333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302938e-a562-4fe2-8e18-ebd90f122a77 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:02.767040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302938e-a562-4fe2-8e18-ebd90f122a77 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:02.767566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302938e-a562-4fe2-8e18-ebd90f122a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:02.771738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 894/1766] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:02.848620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4302938e-a562-4fe2-8e18-ebd90f122a77 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:02.852778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4302938e-a562-4fe2-8e18-ebd90f122a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:02.874365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:02.884802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 873/1767] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:02.896661 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3c613-7e4e-47fb-b940-9a46292b1336 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:02.909644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:02.914908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:02.914908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:02.914908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:02.917272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:02.919276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:02.927132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:02.985945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302938e-a562-4fe2-8e18-ebd90f122a77 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:02.996332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 895/1768] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:14:03.007533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302938e-a562-4fe2-8e18-ebd90f122a77 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:03.018046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:03.019605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:03.020310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:03.020872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:03.022322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:03.026567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:03.188374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 874/1769] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:02 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:03.189978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:03.214940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:03.217977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:03.227909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31513bf-ec31-43da-bf46-f9bf7aebbde3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:03.393466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:03.393466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:03.393466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:03.393466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:03.401087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:03.401087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:03.457293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0c75-277c-4aea-bbb0-f5502370c28a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:03.475496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:03.478181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:03.478628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:03.479135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:03.533085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:03.533085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:03.592888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 875/1770] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:03.595445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 896/1771] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:03 2022] POST /identity/v3/users => generated 284 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:03.599643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:03.623067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225df37-6ae7-4330-a0f2-287b89fc8b7a service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:03.641328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:03.642176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:03.642450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:03.642752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:03.643497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:03.645098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:03.685270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 876/1772] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:03.689588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:03.710817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528afacd-04ac-4152-aa4c-d1ce36721fef admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:03.721945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc30ac-aa8f-41e4-be3a-6a6c09a73f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:03.722673 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc30ac-aa8f-41e4-be3a-6a6c09a73f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:03.723429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc30ac-aa8f-41e4-be3a-6a6c09a73f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:03.723429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc30ac-aa8f-41e4-be3a-6a6c09a73f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:03.723943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc30ac-aa8f-41e4-be3a-6a6c09a73f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:03.725550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc30ac-aa8f-41e4-be3a-6a6c09a73f45 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:03.750882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 897/1773] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:03.755322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:03.777907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539c486-2aae-4f68-a38d-6fea48ce30f4 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:03.788280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:03.805111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:03.805111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:03.805111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] PATH_INFO: `/v3/projects/ac0843a43b3b4049bb02fcdca73cfd78/users/b8e7b01231b340bca494dcd2fe72b166/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:03.839278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0843a43b3b4049bb02fcdca73cfd78, user_id=b8e7b01231b340bca494dcd2fe72b166, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:03.842773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:04.001716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 877/1774] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:03 2022] PUT /identity/v3/projects/ac0843a43b3b4049bb02fcdca73cfd78/users/b8e7b01231b340bca494dcd2fe72b166/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:04.015200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6682f6-e55b-4ff0-bd7f-aad30f74efae None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:04.016153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6682f6-e55b-4ff0-bd7f-aad30f74efae None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:04.016576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6682f6-e55b-4ff0-bd7f-aad30f74efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:04.117870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ea6682f6-e55b-4ff0-bd7f-aad30f74efae None None] MFA Rules not processed for user `b8e7b01231b340bca494dcd2fe72b166`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:04.119220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ea6682f6-e55b-4ff0-bd7f-aad30f74efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:04.128737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:04.130976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:04.294855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 898/1775] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:04.299900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6682f6-e55b-4ff0-bd7f-aad30f74efae None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:04.432456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95c9ca-097e-448b-967d-27da6d589432 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:04.459160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:04.460445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:04.462692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:04.463472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] PATH_INFO: `/v3/users/b7ba947807f04e6baa55b6ac479b3ddd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:04.467260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ba947807f04e6baa55b6ac479b3ddd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:04.469396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:04.481399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6682f6-e55b-4ff0-bd7f-aad30f74efae None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:04.503596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:04.504306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:04.504598 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:04.504977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:04.505774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:04.508871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:05.021096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 899/1776] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:04 2022] POST /identity/v3/projects => generated 369 bytes in 722 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:05.037205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:05.037205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:05.184707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b25c-3c45-4342-8595-d450793f7268 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:05.191114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:05.192628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:05.193088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:05.193433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] PATH_INFO: `/v3/users/b8a2f15deb88420ab56c0765812e65b6` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:05.194829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a2f15deb88420ab56c0765812e65b6)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:05.197850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:05.350107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ba947807f04e6baa55b6ac479b3ddd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.539995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ba947807f04e6baa55b6ac479b3ddd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.555652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ba947807f04e6baa55b6ac479b3ddd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.557585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ba947807f04e6baa55b6ac479b3ddd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.558570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ba947807f04e6baa55b6ac479b3ddd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.575708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 878/1777] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:04 2022] DELETE /identity/v3/users/b7ba947807f04e6baa55b6ac479b3ddd => generated 0 bytes in 1444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:05.577041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:05.578702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:05.663194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a2f15deb88420ab56c0765812e65b6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.664207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a2f15deb88420ab56c0765812e65b6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.672709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd63d-8075-4589-ac91-b7bc7e0081f8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:05.679787 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58066bf-28d2-4610-87e5-ba8bb0b10be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:05.681477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58066bf-28d2-4610-87e5-ba8bb0b10be6 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:05.681966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58066bf-28d2-4610-87e5-ba8bb0b10be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:05.682484 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58066bf-28d2-4610-87e5-ba8bb0b10be6 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:05.683397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58066bf-28d2-4610-87e5-ba8bb0b10be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:05.685628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58066bf-28d2-4610-87e5-ba8bb0b10be6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:05.698841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a2f15deb88420ab56c0765812e65b6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.900764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a2f15deb88420ab56c0765812e65b6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.905357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a2f15deb88420ab56c0765812e65b6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:05.911724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 879/1778] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:05 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:05.914263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706fa5-48f3-4962-b549-5e63a4a43554 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:05.914992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706fa5-48f3-4962-b549-5e63a4a43554 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:05.915287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706fa5-48f3-4962-b549-5e63a4a43554 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:05.917259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 880/1779] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:14:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:14:05.918350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa053-345b-446c-b694-3282229b220d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:05.918735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa053-345b-446c-b694-3282229b220d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:05.919016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa053-345b-446c-b694-3282229b220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:05.951657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 900/1780] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:05 2022] DELETE /identity/v3/users/b8a2f15deb88420ab56c0765812e65b6 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:05.952395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:05.956086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a8caa053-345b-446c-b694-3282229b220d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:05.957310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a8caa053-345b-446c-b694-3282229b220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:05.967031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:06.058225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06a473-1d87-4488-9f12-89544ff38fcb admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:06.065768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa5766-a176-425e-88df-7878affa0b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:06.066705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5766-a176-425e-88df-7878affa0b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.067876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5766-a176-425e-88df-7878affa0b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.068488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5766-a176-425e-88df-7878affa0b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.069384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa5766-a176-425e-88df-7878affa0b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:06.073078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa5766-a176-425e-88df-7878affa0b91 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:06.091646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 901/1781] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:06.091646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.091646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.091646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.113680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:06.114993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:06.133845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 881/1782] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:06.134730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0f799-4c55-4cf5-833c-f6ce47dc2f2c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.146871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0f799-4c55-4cf5-833c-f6ce47dc2f2c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.147202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0f799-4c55-4cf5-833c-f6ce47dc2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.180897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-09b0f799-4c55-4cf5-833c-f6ce47dc2f2c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:06.182284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-09b0f799-4c55-4cf5-833c-f6ce47dc2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:06.207688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 882/1783] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:06.208671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0f799-4c55-4cf5-833c-f6ce47dc2f2c None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:06.236973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0f799-4c55-4cf5-833c-f6ce47dc2f2c None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:06.255010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 902/1784] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:14:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:06.270009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:06.270009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:06.270262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:06.270262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.270262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.270262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] PATH_INFO: `/v3/projects/93f8fdb9aede491ca1363fb94b0623b6/users/1fdc17cbff7447e2a71e3e0695f3ca44/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.306139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f8fdb9aede491ca1363fb94b0623b6, user_id=1fdc17cbff7447e2a71e3e0695f3ca44, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:06.321571 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:06.383334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd720dc-9add-4bf3-8c43-2b24c8feb168 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:06.409128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:06.409874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.410154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.410433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.426461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:06.427994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:06.440370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 903/1785] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:06.441510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:06.477801 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8665c30-b207-4a35-b6ad-d3b9501da82c service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:06.485809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:06.488186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.488808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.490802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.513276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:06.514979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:06.553883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 904/1786] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:06.555776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:06.557392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:06.558746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 883/1787] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:06 2022] PUT /identity/v3/projects/93f8fdb9aede491ca1363fb94b0623b6/users/1fdc17cbff7447e2a71e3e0695f3ca44/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:06.562521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:06.582702 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224748f9-f4a7-44c6-89c1-f89a61192882 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:06.689363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151e177-0435-49cb-8baa-fee863d341a5 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:06.703550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:06.704818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.705219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.705593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.706340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:06.708693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:06.715956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145596d5-338a-4d8c-b682-1521731074a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:06.716853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145596d5-338a-4d8c-b682-1521731074a7 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.717156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145596d5-338a-4d8c-b682-1521731074a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.717439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145596d5-338a-4d8c-b682-1521731074a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.722417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 884/1788] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:06.726178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:06.740850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d2ff3-2d21-4f32-90aa-b41e736eab9e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:06.749295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145596d5-338a-4d8c-b682-1521731074a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:06.751330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145596d5-338a-4d8c-b682-1521731074a7 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:06.754730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:06.755729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.756366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.756493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] PATH_INFO: `/v3/projects/93f8fdb9aede491ca1363fb94b0623b6/users/1fdc17cbff7447e2a71e3e0695f3ca44/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.762031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f8fdb9aede491ca1363fb94b0623b6, user_id=1fdc17cbff7447e2a71e3e0695f3ca44, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:06.765493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:06.771027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 905/1789] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:06.792953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 885/1790] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:06 2022] PUT /identity/v3/projects/93f8fdb9aede491ca1363fb94b0623b6/users/1fdc17cbff7447e2a71e3e0695f3ca44/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:06.805145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:06.805884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:06.806568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:06.862788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] MFA Rules not processed for user `1fdc17cbff7447e2a71e3e0695f3ca44`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:06.864167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:07.021066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 906/1791] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:07.032462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:07.036353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:07.184407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f73a-5e36-41b3-b57d-6c4f32f2eabc admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:07.192022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:07.192379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:07.192784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:07.195227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:07.226322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:07.228746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:07.241159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 886/1792] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:07.300383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:07.301481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:07.304603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:07.305575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:07.509220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb83bb-043e-45bd-9a5a-61980c4c1342 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:07.526395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:07.528382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:07.528720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:07.529004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] PATH_INFO: `/v3/projects/1f7e93e38e06412fa948d40608635947` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:07.534047 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7e93e38e06412fa948d40608635947)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:07.537793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a14b-7511-4473-82d8-ce3abe2ff069 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:07.540249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:07.552817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:07.553964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:07.554406 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:07.554978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] PATH_INFO: `/v3/projects/62979a968dd14c99815af4d5fd3663ed` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:07.556405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62979a968dd14c99815af4d5fd3663ed)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:07.561654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:07.707448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62979a968dd14c99815af4d5fd3663ed', 'request_id': 'req-fd46f371-b500-4d8e-bd6b-eb21abb91046'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:07.740517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7e93e38e06412fa948d40608635947', 'request_id': 'req-d0fdef77-a901-418f-9388-8f465d5f7b3e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:07.756402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7e93e38e06412fa948d40608635947', 'request_id': 'req-d0fdef77-a901-418f-9388-8f465d5f7b3e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:07.808125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62979a968dd14c99815af4d5fd3663ed', 'request_id': 'req-fd46f371-b500-4d8e-bd6b-eb21abb91046'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:07.815224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62979a968dd14c99815af4d5fd3663ed', 'request_id': 'req-fd46f371-b500-4d8e-bd6b-eb21abb91046'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:07.852573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] The token cache is being invalidate because project 62979a968dd14c99815af4d5fd3663ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:07.852975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:07.858869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:07.860742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 887/1793] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:07 2022] DELETE /identity/v3/projects/62979a968dd14c99815af4d5fd3663ed => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:07.861663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:07.863286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:08.014553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46f371-b500-4d8e-bd6b-eb21abb91046 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:08.139114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdaecd-8d85-4bd0-9015-3ed220828081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:08.140846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdaecd-8d85-4bd0-9015-3ed220828081 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.141274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdaecd-8d85-4bd0-9015-3ed220828081 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.141563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdaecd-8d85-4bd0-9015-3ed220828081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.145382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4fcdaecd-8d85-4bd0-9015-3ed220828081 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:08.226198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdaecd-8d85-4bd0-9015-3ed220828081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:08.228130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdaecd-8d85-4bd0-9015-3ed220828081 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:08.241897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 888/1794] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:08.243421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863d9f-2336-4dcd-8cfc-b07853f6f341 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.243714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863d9f-2336-4dcd-8cfc-b07853f6f341 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.244272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863d9f-2336-4dcd-8cfc-b07853f6f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.274872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-15863d9f-2336-4dcd-8cfc-b07853f6f341 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:08.276097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-15863d9f-2336-4dcd-8cfc-b07853f6f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:08.350127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 889/1795] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:08.358593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a203e-3e3f-4c0b-bbd5-9d5a288b3dc6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.359525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a203e-3e3f-4c0b-bbd5-9d5a288b3dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.359525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a203e-3e3f-4c0b-bbd5-9d5a288b3dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.380083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6b3a203e-3e3f-4c0b-bbd5-9d5a288b3dc6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:08.381296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6b3a203e-3e3f-4c0b-bbd5-9d5a288b3dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:08.390219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 890/1796] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:08.394378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a203e-3e3f-4c0b-bbd5-9d5a288b3dc6 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:08.405239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a203e-3e3f-4c0b-bbd5-9d5a288b3dc6 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:08.410428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:08.411363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.411811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.412233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.413631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:08.413759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:08.415460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:08.429323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 891/1797] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:14:08.433610 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:08.444048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c50f87-2927-4589-af00-e7fc9362ce36 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:08.450457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:08.453994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.453994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.453994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.453994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:08.454434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:08.508804 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7e93e38e06412fa948d40608635947', 'request_id': 'req-d0fdef77-a901-418f-9388-8f465d5f7b3e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:08.529188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] The token cache is being invalidate because project 1f7e93e38e06412fa948d40608635947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:08.529732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:08.530679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:08.534201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 907/1798] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:07 2022] DELETE /identity/v3/projects/1f7e93e38e06412fa948d40608635947 => generated 0 bytes in 1234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:08.537086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:08.539330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:08.554728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdef77-a901-418f-9388-8f465d5f7b3e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:08.563365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:08.564425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.566176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.566524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] PATH_INFO: `/v3/users/65aef20587014309b7baebc008ce0e15` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.568711 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=65aef20587014309b7baebc008ce0e15)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:08.573161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:08.614473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 892/1799] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:08 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:08.619186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:08.620983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:08.720197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75432e92-3d7e-4762-9599-3488cf719c33 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:08.721890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:08.722584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.723493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.723493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.723902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:08.726063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:08.871433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 893/1800] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:08 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:08.876173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:08.888841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa7719-41e5-4cc1-bc3e-e889ef622129 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:08.901701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:08.904449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.904449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.904693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.905336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:08.907160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:08.918507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 894/1801] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:08.927779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:08.943064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65aef20587014309b7baebc008ce0e15'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:08.946302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65aef20587014309b7baebc008ce0e15'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:08.957367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd294-2476-4286-8cc9-f9345ba6a560 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:08.965094 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:08.965785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:08.966097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:08.966333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:08.967134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:08.968939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:08.977318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65aef20587014309b7baebc008ce0e15'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:08.985370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 895/1802] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:08.993783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:09.010222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79974-0d77-4124-8a8d-ab94d32adbb1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:09.019017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:09.023824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:09.023824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:09.023824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] PATH_INFO: `/v3/projects/e74defb771bf498b9375b398c32e7eec/users/0576f1c15a0544fc85642ac7d857d95b/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:09.075447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74defb771bf498b9375b398c32e7eec, user_id=0576f1c15a0544fc85642ac7d857d95b, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:09.076423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65aef20587014309b7baebc008ce0e15'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:09.077553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3076785e-a270-47bf-a49f-1dd4a6f2a5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65aef20587014309b7baebc008ce0e15'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:09.079208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:09.104322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 908/1803] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:08 2022] DELETE /identity/v3/users/65aef20587014309b7baebc008ce0e15 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:09.212792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 896/1804] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:08 2022] PUT /identity/v3/projects/e74defb771bf498b9375b398c32e7eec/users/0576f1c15a0544fc85642ac7d857d95b/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:09.224615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f5856-33f1-4d3a-90c4-8c5a3e4b6833 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:09.225021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f5856-33f1-4d3a-90c4-8c5a3e4b6833 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:09.225491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f5856-33f1-4d3a-90c4-8c5a3e4b6833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:09.265910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a63f5856-33f1-4d3a-90c4-8c5a3e4b6833 None None] MFA Rules not processed for user `0576f1c15a0544fc85642ac7d857d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:09.267448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a63f5856-33f1-4d3a-90c4-8c5a3e4b6833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:09.364549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 909/1805] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:09.370027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:09.372124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:09.447458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7e67a-a93c-49ef-881d-581f607c3f05 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:09.453979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:09.454804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:09.455335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:09.455736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:09.456533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:09.458951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:09.601379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 897/1806] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:09 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:09.605533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f5856-33f1-4d3a-90c4-8c5a3e4b6833 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:09.616972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f5856-33f1-4d3a-90c4-8c5a3e4b6833 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:09.671944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:09.672632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:09.673011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:09.673181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:09.673875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:09.675825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:09.678800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:09.681316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:09.696923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39ffb-4c82-49d8-a8cf-68ff574d324a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:09.701829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:09.702931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:09.703210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:09.703480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] PATH_INFO: `/v3/projects/9a20017665e949658394f870360e6b35` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:09.707662 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a20017665e949658394f870360e6b35)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:09.709654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:09.768853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 910/1807] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:09 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:09.770527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:09.781147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352bd02-b21a-4f40-b4ea-a3efb73c365b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:09.786307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:09.787073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:09.787353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:09.788233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:09.789264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:09.790908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:09.812828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 911/1808] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:09.817079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:09.827076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c002-883f-44d2-a0de-ecc3190f590e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:09.831909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:09.832819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:09.833099 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:09.833374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] PATH_INFO: `/v3/projects/fc6896261e184cf095d84875f151a75c/users/80a054513e4f4b4488feca59d875055a/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:09.851179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6896261e184cf095d84875f151a75c, user_id=80a054513e4f4b4488feca59d875055a, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:09.853865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:09.864320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a20017665e949658394f870360e6b35', 'request_id': 'req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:09.962711 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 912/1809] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:09 2022] PUT /identity/v3/projects/fc6896261e184cf095d84875f151a75c/users/80a054513e4f4b4488feca59d875055a/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:09.976597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.005052 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a20017665e949658394f870360e6b35', 'request_id': 'req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:10.012798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a20017665e949658394f870360e6b35', 'request_id': 'req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:10.025877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] The token cache is being invalidate because project 9a20017665e949658394f870360e6b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:10.026090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:10.026803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7fdc0da4-9e50-41d3-81f8-bc1bf6fb4bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:10.028519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 898/1810] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:09 2022] DELETE /identity/v3/projects/9a20017665e949658394f870360e6b35 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:10.033959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac830f-08ce-4bde-8913-1d73431ef4b6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.034380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac830f-08ce-4bde-8913-1d73431ef4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.034685 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac830f-08ce-4bde-8913-1d73431ef4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.043042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86643-f5aa-4c32-b1f4-fcbc885e1aff admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.048041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.048719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.048996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.049275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.050002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.056585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.056785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-eeac830f-08ce-4bde-8913-1d73431ef4b6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:10.056785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-eeac830f-08ce-4bde-8913-1d73431ef4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:10.065692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 913/1811] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:10.066389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 899/1812] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:10.067723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.070059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:10.073177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d3ca-fbc5-4c73-b825-203b725b4792 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.073469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d3ca-fbc5-4c73-b825-203b725b4792 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.073754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d3ca-fbc5-4c73-b825-203b725b4792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.082950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c75cf0-fe91-4d0e-ab96-941f9e0bd6f7 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.088155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a031-b875-45ed-9ff6-64e67f6ed9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.089044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a031-b875-45ed-9ff6-64e67f6ed9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.089322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a031-b875-45ed-9ff6-64e67f6ed9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.089595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a031-b875-45ed-9ff6-64e67f6ed9ed admin admin] PATH_INFO: `/v3/projects/fc6896261e184cf095d84875f151a75c/users/80a054513e4f4b4488feca59d875055a/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.092870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d761d3ca-fbc5-4c73-b825-203b725b4792 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:10.093032 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a031-b875-45ed-9ff6-64e67f6ed9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6896261e184cf095d84875f151a75c, user_id=80a054513e4f4b4488feca59d875055a, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.094075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d761d3ca-fbc5-4c73-b825-203b725b4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:10.095564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a031-b875-45ed-9ff6-64e67f6ed9ed admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.103912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 900/1813] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:10.107788 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761d3ca-fbc5-4c73-b825-203b725b4792 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.108112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 914/1814] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:10 2022] PUT /identity/v3/projects/fc6896261e184cf095d84875f151a75c/users/80a054513e4f4b4488feca59d875055a/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:10.118244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761d3ca-fbc5-4c73-b825-203b725b4792 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.118988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.119357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.119627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.148266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] MFA Rules not processed for user `80a054513e4f4b4488feca59d875055a`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:10.149949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:10.190802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.191478 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.191765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.192038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.192777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:10.193083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.195450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.210791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 901/1815] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:14:10.214966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.228178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12060e9-3153-4df1-8af5-11d2a6281b4f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.234217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.234956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.235225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.235500 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.236239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.238181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.244835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 915/1816] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:10.262541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.266670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:10.327783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842cc45-ce5d-4bb8-b43c-93ad34c83089 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.332295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.332295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.332631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.332922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.343354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.344794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.355136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 916/1817] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:10.403809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 902/1818] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:10 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:10.408190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.419747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c212ef0-da0e-494c-b3a8-dc440daa9444 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.476684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.477375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.477648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.477927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.478659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.480581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.618180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 917/1819] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:10 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:10.622826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.633266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a1e00-3b6a-48b1-b3c5-66dc6771a091 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.637789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.638463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.638790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.639068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.639804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.641401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.653592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 903/1820] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:10.656504 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.664640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.668303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b428d-53b5-4b29-8c9d-205822e11b2b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.673458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.674183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.674459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.675141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.675753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.677328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.688773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 918/1821] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:10.693143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:10.703324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c0f39-bbea-483f-afed-c00cee0285fe admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.707999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.708895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.709262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.709664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] PATH_INFO: `/v3/projects/5819f3690560457598a55eebc066206a/users/2d9fc4b78d32443fb8d480a66100d7d7/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.724707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=5819f3690560457598a55eebc066206a, user_id=2d9fc4b78d32443fb8d480a66100d7d7, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.725474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277ba6-b01a-4ffe-96e3-5e403390ca9e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:10.728121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.729749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de968596-e5a5-4be7-9a09-6d606ccee885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:10.731928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968596-e5a5-4be7-9a09-6d606ccee885 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.731928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968596-e5a5-4be7-9a09-6d606ccee885 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.731928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968596-e5a5-4be7-9a09-6d606ccee885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.733225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-de968596-e5a5-4be7-9a09-6d606ccee885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:10.792780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de968596-e5a5-4be7-9a09-6d606ccee885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:10.794486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de968596-e5a5-4be7-9a09-6d606ccee885 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:10.805592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 904/1822] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:10.825351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 919/1823] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:10 2022] PUT /identity/v3/projects/5819f3690560457598a55eebc066206a/users/2d9fc4b78d32443fb8d480a66100d7d7/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:10.835985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef862bd-1917-4795-afde-8e10fdcb7bc8 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:10.836275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef862bd-1917-4795-afde-8e10fdcb7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:10.836523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef862bd-1917-4795-afde-8e10fdcb7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:10.867295 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6ef862bd-1917-4795-afde-8e10fdcb7bc8 None None] MFA Rules not processed for user `2d9fc4b78d32443fb8d480a66100d7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:10.868827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6ef862bd-1917-4795-afde-8e10fdcb7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:10.943395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 905/1824] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:10.948104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:11.013307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f4991-3f61-47e3-b870-312200a44bda admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:11.023706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:11.024361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.024704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.024982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.025725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:11.027694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:11.216264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 920/1825] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:10 2022] POST /identity/v3/projects => generated 383 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:11.219883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef862bd-1917-4795-afde-8e10fdcb7bc8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:11.231042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef862bd-1917-4795-afde-8e10fdcb7bc8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:11.285778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:11.286463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.286772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.287049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.288013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:11.289941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:11.466710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 906/1826] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:11 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:11.478020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:11.489317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022548a-a5a2-4f31-a503-adb825497271 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:11.498438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:11.503334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.503334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.503334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.503334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:11.503334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:11.514165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 921/1827] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:11.518360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:11.529661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f4c07-091f-409a-a1de-c13a9eaf720f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:11.534528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:11.535615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.535890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.536165 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] PATH_INFO: `/v3/projects/6103081629564637866f904a71f685c9/users/b623920b708e404a89b5934861ac58fa/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.552837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6103081629564637866f904a71f685c9, user_id=b623920b708e404a89b5934861ac58fa, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:11.556298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:11.668188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 907/1828] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:11 2022] PUT /identity/v3/projects/6103081629564637866f904a71f685c9/users/b623920b708e404a89b5934861ac58fa/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:11.672347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:11.683139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270677b1-068d-4392-ba61-9096bd617fb5 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:11.739931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c1abf-dafd-4c56-b6a2-87457e2dfe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:11.741856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1abf-dafd-4c56-b6a2-87457e2dfe0c admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.741856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1abf-dafd-4c56-b6a2-87457e2dfe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.741856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1abf-dafd-4c56-b6a2-87457e2dfe0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.742624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c1abf-dafd-4c56-b6a2-87457e2dfe0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:11.744366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c1abf-dafd-4c56-b6a2-87457e2dfe0c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:11.754551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 922/1829] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:11.759595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:11.770138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb1573-af65-4611-9899-fb41ee087013 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:11.775019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:11.775914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.776193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.776470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] PATH_INFO: `/v3/projects/6103081629564637866f904a71f685c9/users/b623920b708e404a89b5934861ac58fa/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.778449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6103081629564637866f904a71f685c9, user_id=b623920b708e404a89b5934861ac58fa, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:11.781249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:11.792335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 908/1830] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:11 2022] PUT /identity/v3/projects/6103081629564637866f904a71f685c9/users/b623920b708e404a89b5934861ac58fa/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:11.804678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683500c-108b-4da6-9f78-350819afdf9b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.809105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683500c-108b-4da6-9f78-350819afdf9b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.809105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683500c-108b-4da6-9f78-350819afdf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.833003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c683500c-108b-4da6-9f78-350819afdf9b None None] MFA Rules not processed for user `b623920b708e404a89b5934861ac58fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:11.834273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c683500c-108b-4da6-9f78-350819afdf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:11.906654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 923/1831] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:11.917730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:11.919680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:11.980819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96352e-c1d4-499c-893f-065da3f7b69a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:11.984582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:11.985292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:11.989403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:11.989403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:11.998437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:11.999607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:12.017299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 909/1832] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:12.108626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683500c-108b-4da6-9f78-350819afdf9b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:12.119097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683500c-108b-4da6-9f78-350819afdf9b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:12.122648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5d068-87bb-4d1d-a877-361bf62226d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:12.123337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d068-87bb-4d1d-a877-361bf62226d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:12.123616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d068-87bb-4d1d-a877-361bf62226d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:12.123889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d068-87bb-4d1d-a877-361bf62226d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:12.185106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5d068-87bb-4d1d-a877-361bf62226d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:12.186496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5d068-87bb-4d1d-a877-361bf62226d5 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:12.195995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 924/1833] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:15.582304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:15.584996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:15.675621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6bf5-446a-4e65-8f56-b4d799171532 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:15.682005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:15.683096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:15.683301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:15.683726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] PATH_INFO: `/v3/users/b8e7b01231b340bca494dcd2fe72b166` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:15.684808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e7b01231b340bca494dcd2fe72b166)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:15.686776 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:16.034827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e7b01231b340bca494dcd2fe72b166'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:16.163512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e7b01231b340bca494dcd2fe72b166'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:16.187915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e7b01231b340bca494dcd2fe72b166'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:16.189578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e7b01231b340bca494dcd2fe72b166'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:16.190275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e7b01231b340bca494dcd2fe72b166'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:16.245183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 910/1834] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:15 2022] DELETE /identity/v3/users/b8e7b01231b340bca494dcd2fe72b166 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:16.263811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:16.263811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:16.263811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:16.298486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:16.299772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:16.371211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 925/1835] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:16.381061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:16.382521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:16.442815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17693e-f510-4a56-a21f-7c20c5cb25f0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:16.446365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:16.447067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:16.447347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:16.447701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:16.457171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:16.459265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:16.473198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 911/1836] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:17.179326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:17.180871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:17.199714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db562d33-d61a-460e-ab76-a4a5afba82ff None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:17.208578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:17.208578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:17.208578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:17.209122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] PATH_INFO: `/v3/projects/ac0843a43b3b4049bb02fcdca73cfd78` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:17.210228 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0843a43b3b4049bb02fcdca73cfd78)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:17.212761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:17.382372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0843a43b3b4049bb02fcdca73cfd78', 'request_id': 'req-e65fa55c-2966-4e25-9057-4f674266af58'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:17.387590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0843a43b3b4049bb02fcdca73cfd78', 'request_id': 'req-e65fa55c-2966-4e25-9057-4f674266af58'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:17.520496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0843a43b3b4049bb02fcdca73cfd78', 'request_id': 'req-e65fa55c-2966-4e25-9057-4f674266af58'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:17.533167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] The token cache is being invalidate because project ac0843a43b3b4049bb02fcdca73cfd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:17.533465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:17.534139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:17.536456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 926/1837] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:17 2022] DELETE /identity/v3/projects/ac0843a43b3b4049bb02fcdca73cfd78 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:17.541678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:17.553366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9886-da2d-4228-8529-9335db56b0b7 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:17.635193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:17.636118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:17.639791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:17.639791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] PATH_INFO: `/v3/users/1fdc17cbff7447e2a71e3e0695f3ca44` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:17.639791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fdc17cbff7447e2a71e3e0695f3ca44)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:17.640051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:17.865857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:17.877482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:17.897133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fa55c-2966-4e25-9057-4f674266af58 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:17.903866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:17.906060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:17.906060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:17.906060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] PATH_INFO: `/v3/users/2d9fc4b78d32443fb8d480a66100d7d7` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:17.907585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9fc4b78d32443fb8d480a66100d7d7)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:17.909829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:17.958407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fdc17cbff7447e2a71e3e0695f3ca44'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.108529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fdc17cbff7447e2a71e3e0695f3ca44'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.125328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fdc17cbff7447e2a71e3e0695f3ca44'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.126443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fdc17cbff7447e2a71e3e0695f3ca44'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.127423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cd9bd1b4-b50d-48fa-a3ef-b5b383e579bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fdc17cbff7447e2a71e3e0695f3ca44'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.147410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 912/1838] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:17 2022] DELETE /identity/v3/users/1fdc17cbff7447e2a71e3e0695f3ca44 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:18.252145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9fc4b78d32443fb8d480a66100d7d7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.252924 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9fc4b78d32443fb8d480a66100d7d7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.260639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9fc4b78d32443fb8d480a66100d7d7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.397636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9fc4b78d32443fb8d480a66100d7d7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.398367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9fc4b78d32443fb8d480a66100d7d7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:18.421611 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 927/1839] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:17 2022] DELETE /identity/v3/users/2d9fc4b78d32443fb8d480a66100d7d7 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:18.426326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:18.427066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:18.427066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:18.450771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:18.450771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:18.518426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 913/1840] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:18.529395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:18.530844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:18.598862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ee35a-65f6-4b9d-be69-3abc58c593b3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:18.602842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054bb0-6890-400c-b67a-e329997b1bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:18.603503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054bb0-6890-400c-b67a-e329997b1bbe service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:18.603833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054bb0-6890-400c-b67a-e329997b1bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:18.604087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054bb0-6890-400c-b67a-e329997b1bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:18.614924 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054bb0-6890-400c-b67a-e329997b1bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:18.616368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054bb0-6890-400c-b67a-e329997b1bbe service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:18.628836 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 928/1841] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:18.688108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:18.690339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:18.706996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68114efd-0ff6-4fde-b994-4dfb9bc8c1e7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:18.713989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:18.714945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:18.715227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:18.715908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] PATH_INFO: `/v3/projects/93f8fdb9aede491ca1363fb94b0623b6` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:18.717259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f8fdb9aede491ca1363fb94b0623b6)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:18.730579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:18.951195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f8fdb9aede491ca1363fb94b0623b6', 'request_id': 'req-73e9a813-0bef-423f-aaa6-80837cff24d2'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.045272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f8fdb9aede491ca1363fb94b0623b6', 'request_id': 'req-73e9a813-0bef-423f-aaa6-80837cff24d2'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.052413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f8fdb9aede491ca1363fb94b0623b6', 'request_id': 'req-73e9a813-0bef-423f-aaa6-80837cff24d2'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.066989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] The token cache is being invalidate because project 93f8fdb9aede491ca1363fb94b0623b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:19.067195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.068215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-73e9a813-0bef-423f-aaa6-80837cff24d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.069892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 914/1842] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:18 2022] DELETE /identity/v3/projects/93f8fdb9aede491ca1363fb94b0623b6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:19.075218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220762b-1370-45af-9e71-7c6ad10a47cd None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.075833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220762b-1370-45af-9e71-7c6ad10a47cd None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.076122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220762b-1370-45af-9e71-7c6ad10a47cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.097197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8220762b-1370-45af-9e71-7c6ad10a47cd None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:19.099022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8220762b-1370-45af-9e71-7c6ad10a47cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:19.163296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 929/1843] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:19.172309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c9a8-9737-4460-a2ab-e9dade5f76d4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.172595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c9a8-9737-4460-a2ab-e9dade5f76d4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.172879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c9a8-9737-4460-a2ab-e9dade5f76d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.192010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-df23c9a8-9737-4460-a2ab-e9dade5f76d4 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:19.193464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-df23c9a8-9737-4460-a2ab-e9dade5f76d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:19.201297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 915/1844] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:19.205656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220762b-1370-45af-9e71-7c6ad10a47cd None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.216460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220762b-1370-45af-9e71-7c6ad10a47cd None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.221040 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.221709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.221986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.222261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.223070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:19.223545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.225245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.237595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 930/1845] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:14:19.242178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c9a8-9737-4460-a2ab-e9dade5f76d4 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.251723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c9a8-9737-4460-a2ab-e9dade5f76d4 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.257294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.257959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.258238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.258507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.259383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.261174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.263901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.265523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:19.281380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068e199-f475-446e-9229-292b70ced0ed admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.286191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.286931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.287406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.287596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] PATH_INFO: `/v3/projects/5819f3690560457598a55eebc066206a` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.289067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5819f3690560457598a55eebc066206a)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.291495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.401529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 916/1846] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:19 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:19.402820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.446185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5819f3690560457598a55eebc066206a', 'request_id': 'req-1c609b46-530b-4162-8c69-00dbdc0f78a1'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.452256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5819f3690560457598a55eebc066206a', 'request_id': 'req-1c609b46-530b-4162-8c69-00dbdc0f78a1'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.487789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bf35b-6958-4357-8479-3a21c55452eb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.537666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5819f3690560457598a55eebc066206a', 'request_id': 'req-1c609b46-530b-4162-8c69-00dbdc0f78a1'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.550845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.552182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.552463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.552750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.553461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.555036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] The token cache is being invalidate because project 5819f3690560457598a55eebc066206a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:19.555356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.555606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.555996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.557880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 931/1847] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:19 2022] DELETE /identity/v3/projects/5819f3690560457598a55eebc066206a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:19.561544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.563058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:19.575716 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c609b46-530b-4162-8c69-00dbdc0f78a1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.580468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.581397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.581677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.581983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] PATH_INFO: `/v3/users/b623920b708e404a89b5934861ac58fa` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.583888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b623920b708e404a89b5934861ac58fa)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.585809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.646621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 917/1848] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:19 2022] POST /identity/v3/users => generated 301 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:19.650783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.652411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:19.665699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc669b9-dd25-4c62-a646-7f600a81d165 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.670899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.671595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.671847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.674403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.674403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.674403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.685128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 918/1849] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:19.689276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.699886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d922a-0985-4347-8477-2208b86c26eb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.704623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.705302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.705579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.705859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.706586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.708996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.720030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 919/1850] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:19.725403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.735392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1a3a-e99f-4d13-9e1b-420a371c2e6a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:19.740251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:19.741148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.741424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.741699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] PATH_INFO: `/v3/projects/781f671cf30b4b0599cc9b8d9336961d/users/c1e181ce79ed4d43b4549f77a8972642/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.745292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b623920b708e404a89b5934861ac58fa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.745986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b623920b708e404a89b5934861ac58fa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.753185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b623920b708e404a89b5934861ac58fa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.757206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781f671cf30b4b0599cc9b8d9336961d, user_id=c1e181ce79ed4d43b4549f77a8972642, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:19.760116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:19.831670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b623920b708e404a89b5934861ac58fa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.832821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0e041936-4c9e-45d8-a60d-1fa1764a0b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b623920b708e404a89b5934861ac58fa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:19.855796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 932/1851] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:19 2022] DELETE /identity/v3/users/b623920b708e404a89b5934861ac58fa => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:19.873627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 920/1852] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:19 2022] PUT /identity/v3/projects/781f671cf30b4b0599cc9b8d9336961d/users/c1e181ce79ed4d43b4549f77a8972642/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:19.885313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3d38a-6cfe-4dda-9cf1-9f0db21e162e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:19.885604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3d38a-6cfe-4dda-9cf1-9f0db21e162e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:19.885879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3d38a-6cfe-4dda-9cf1-9f0db21e162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:19.916214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-60b3d38a-6cfe-4dda-9cf1-9f0db21e162e None None] MFA Rules not processed for user `c1e181ce79ed4d43b4549f77a8972642`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:19.917735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-60b3d38a-6cfe-4dda-9cf1-9f0db21e162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:19.989774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 933/1853] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:19.994371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:19.996161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:20.088579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01801a17-74e1-4fc1-8e5c-c3b373800c17 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.093898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.094716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.095084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.095500 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.096496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.099448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.198797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 921/1854] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:19 2022] POST /identity/v3/projects => generated 399 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:20.199815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3d38a-6cfe-4dda-9cf1-9f0db21e162e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.210828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3d38a-6cfe-4dda-9cf1-9f0db21e162e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.286029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.286791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.287070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.287341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.288032 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.290105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.394914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.396917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:20.410303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b0824-5f7c-4b9d-9d83-df679c4cdeab admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.415518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.416499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.416883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.417522 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] PATH_INFO: `/v3/projects/6103081629564637866f904a71f685c9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.418883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6103081629564637866f904a71f685c9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.420885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.424955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 934/1855] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:20 2022] POST /identity/v3/users => generated 306 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:20.429608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.446743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fe55c-d81a-43ea-bd8b-79b170c4aa4f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.446743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.447355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.447355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.448363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.448363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.449990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.460155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 935/1856] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:20.464427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.473875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055cfe9-682d-44c3-8d41-b02971ee5426 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.478496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.479380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.479656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.479925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] PATH_INFO: `/v3/projects/6413c98c794d4655a3db1d02679acaf8/users/e06e7bb4971a486ba87a781b5da03f76/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.496068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6413c98c794d4655a3db1d02679acaf8, user_id=e06e7bb4971a486ba87a781b5da03f76, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.498906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.620442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 936/1857] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:20 2022] PUT /identity/v3/projects/6413c98c794d4655a3db1d02679acaf8/users/e06e7bb4971a486ba87a781b5da03f76/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:20.624315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.628145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6103081629564637866f904a71f685c9', 'request_id': 'req-98c77e20-dc08-4344-940b-8f41790177e9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:20.689308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a490da6-5166-40a7-b6be-618c360eec4d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.747708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6103081629564637866f904a71f685c9', 'request_id': 'req-98c77e20-dc08-4344-940b-8f41790177e9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:20.748264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.748899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.749395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.749662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.750414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.752156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.754816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6103081629564637866f904a71f685c9', 'request_id': 'req-98c77e20-dc08-4344-940b-8f41790177e9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:20.763399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 937/1858] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:20.768023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.768197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] The token cache is being invalidate because project 6103081629564637866f904a71f685c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:20.768465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:20.769142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-98c77e20-dc08-4344-940b-8f41790177e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:20.770193 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:20.774942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 922/1859] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:20 2022] DELETE /identity/v3/projects/6103081629564637866f904a71f685c9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:20.776287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150aa3-05a8-4a8b-8b54-0abe90adef78 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.776582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150aa3-05a8-4a8b-8b54-0abe90adef78 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.776860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150aa3-05a8-4a8b-8b54-0abe90adef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.784158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e595-a298-41b4-8243-92d5b21fb76d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.790792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff8d58-b977-4be6-8789-6bd0ecc2b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.791798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff8d58-b977-4be6-8789-6bd0ecc2b965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.792401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff8d58-b977-4be6-8789-6bd0ecc2b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.792742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff8d58-b977-4be6-8789-6bd0ecc2b965 admin admin] PATH_INFO: `/v3/projects/6413c98c794d4655a3db1d02679acaf8/users/e06e7bb4971a486ba87a781b5da03f76/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.794975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff8d58-b977-4be6-8789-6bd0ecc2b965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6413c98c794d4655a3db1d02679acaf8, user_id=e06e7bb4971a486ba87a781b5da03f76, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.797413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2f150aa3-05a8-4a8b-8b54-0abe90adef78 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:20.798019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff8d58-b977-4be6-8789-6bd0ecc2b965 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.798650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2f150aa3-05a8-4a8b-8b54-0abe90adef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:20.808304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 923/1860] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:20.815862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8404a-08f6-4bde-9a40-c53f11a90853 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.816269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8404a-08f6-4bde-9a40-c53f11a90853 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.816608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8404a-08f6-4bde-9a40-c53f11a90853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.825898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 938/1861] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:20 2022] PUT /identity/v3/projects/6413c98c794d4655a3db1d02679acaf8/users/e06e7bb4971a486ba87a781b5da03f76/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:20.828474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.828835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.829181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.836911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-58d8404a-08f6-4bde-9a40-c53f11a90853 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:20.838564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-58d8404a-08f6-4bde-9a40-c53f11a90853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:20.860221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] MFA Rules not processed for user `e06e7bb4971a486ba87a781b5da03f76`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:20.865018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:20.904328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 924/1862] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:20.908646 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8404a-08f6-4bde-9a40-c53f11a90853 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.925243 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8404a-08f6-4bde-9a40-c53f11a90853 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.935726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.936620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.937178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.937545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.938759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 939/1863] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:20.938942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:20.939156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.943072 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:20.949081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.950859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:20.956600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 925/1864] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:14:20.963700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:20.974195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebebb4c-1a73-4af2-ab7b-5e64e0dd1589 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:20.979144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:20.979809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:20.980234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:20.980516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:20.981227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:20.983478 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.023004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af653d-38e3-420b-9bb3-ab54255e4fbb None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.026663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.027312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.027594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.027871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.037600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.039056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.048659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 940/1865] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:21.079900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 926/1866] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:20 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:21.084936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:21.095154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514d90-1799-4a9a-ab9a-1ec1bc249cf1 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.150356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.151057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.151339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.151615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.152308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.154250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.279243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 941/1867] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:21 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:21.280453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:21.291201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd0a96-b1ae-41bf-9f23-6f38a13852db admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.295946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.296608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.296889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.297161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.297887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.299495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.314769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 927/1868] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:21.319409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:21.331184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:21.332488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec709-cfba-4e9a-9bd0-e9ba47d8e3c4 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.337891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.338998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.338998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.339187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.340004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.341771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.359530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 942/1869] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:21.360439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:21.371816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c17c8a-2295-4b49-802c-96c499e07d09 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.380950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.380950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.380950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.380950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] PATH_INFO: `/v3/projects/e1a74f89b5aa4f869a1ca185e935592d/users/dce11682f5ee4a828b91d3f50ed43946/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.396860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0107-a0c5-47b4-ba7b-1e6e451c27d1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.398069 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a74f89b5aa4f869a1ca185e935592d, user_id=dce11682f5ee4a828b91d3f50ed43946, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.400620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106b2a9-83ab-4fd8-80f1-88cded1f1ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.401271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106b2a9-83ab-4fd8-80f1-88cded1f1ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.401551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106b2a9-83ab-4fd8-80f1-88cded1f1ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.401718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.401820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106b2a9-83ab-4fd8-80f1-88cded1f1ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.403740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4106b2a9-83ab-4fd8-80f1-88cded1f1ec7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:21.481013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106b2a9-83ab-4fd8-80f1-88cded1f1ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.482517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106b2a9-83ab-4fd8-80f1-88cded1f1ec7 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.502665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 928/1871] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:21.502997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 943/1871] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:21 2022] PUT /identity/v3/projects/e1a74f89b5aa4f869a1ca185e935592d/users/dce11682f5ee4a828b91d3f50ed43946/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:21.520620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd61f-9b85-4997-8257-bf13b4c1df91 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.520865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd61f-9b85-4997-8257-bf13b4c1df91 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.521141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd61f-9b85-4997-8257-bf13b4c1df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.550008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f38dd61f-9b85-4997-8257-bf13b4c1df91 None None] MFA Rules not processed for user `dce11682f5ee4a828b91d3f50ed43946`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:21.552054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f38dd61f-9b85-4997-8257-bf13b4c1df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:21.621319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 929/1872] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:21.626034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:21.688849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47397194-1a46-42fd-809b-e7b9dcf59ad3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.693973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.694653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.694936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.695225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.695916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.697835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:21.811424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 944/1873] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:21 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:21.815251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dd61f-9b85-4997-8257-bf13b4c1df91 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:21.825802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dd61f-9b85-4997-8257-bf13b4c1df91 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:21.887927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:21.889712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:21.889712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:21.889712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:21.890006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:21.893755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:22.029163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 930/1874] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:21 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:22.033354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:22.044473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bec1-f3fa-4569-958b-a1e5680148dc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:22.060600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:22.061627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:22.062093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:22.062574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:22.063532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:22.066334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:22.080258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 945/1875] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:22.085365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:22.096327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6d6e-ac86-49f1-9bde-1703d6ec4dbb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:22.103096 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:22.118774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:22.118774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:22.118774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] PATH_INFO: `/v3/projects/f8c06c68b1f5464ab57f385443d91e25/users/6d8233cf65a14b3d9e7baf6a5ae0d251/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:22.129643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c06c68b1f5464ab57f385443d91e25, user_id=6d8233cf65a14b3d9e7baf6a5ae0d251, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:22.132696 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:22.237100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 931/1876] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:22 2022] PUT /identity/v3/projects/f8c06c68b1f5464ab57f385443d91e25/users/6d8233cf65a14b3d9e7baf6a5ae0d251/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:22.242022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:22.252192 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b62b-efa7-4110-aef8-130970646a9f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:22.322731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4579-f57d-410c-bdd8-1e9cbe2d90cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:22.323748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4579-f57d-410c-bdd8-1e9cbe2d90cf admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:22.324028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4579-f57d-410c-bdd8-1e9cbe2d90cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:22.324311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4579-f57d-410c-bdd8-1e9cbe2d90cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:22.325093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4579-f57d-410c-bdd8-1e9cbe2d90cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:22.326811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4579-f57d-410c-bdd8-1e9cbe2d90cf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:22.340186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 946/1877] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:22.351428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:22.365039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0917c-e493-471a-8c56-c432cb8b3337 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:22.371397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:22.372244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:22.372724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:22.373086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] PATH_INFO: `/v3/projects/f8c06c68b1f5464ab57f385443d91e25/users/6d8233cf65a14b3d9e7baf6a5ae0d251/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:22.376879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c06c68b1f5464ab57f385443d91e25, user_id=6d8233cf65a14b3d9e7baf6a5ae0d251, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:22.380197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:22.393030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 932/1878] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:22 2022] PUT /identity/v3/projects/f8c06c68b1f5464ab57f385443d91e25/users/6d8233cf65a14b3d9e7baf6a5ae0d251/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:22.412286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85014f-b714-48f6-8e22-3c05f86ee4e6 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:22.413236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85014f-b714-48f6-8e22-3c05f86ee4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:22.413744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85014f-b714-48f6-8e22-3c05f86ee4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:22.445728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8f85014f-b714-48f6-8e22-3c05f86ee4e6 None None] MFA Rules not processed for user `6d8233cf65a14b3d9e7baf6a5ae0d251`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:22.448012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8f85014f-b714-48f6-8e22-3c05f86ee4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:22.559462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 947/1879] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:22.571208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:22.573503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:22.691486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36307-783c-46ae-9afb-76ccd47bfe94 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:22.696045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaad2f-aa61-4d0e-bb38-ae13dd42fa86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:22.696719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaad2f-aa61-4d0e-bb38-ae13dd42fa86 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:22.697002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaad2f-aa61-4d0e-bb38-ae13dd42fa86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:22.697275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaad2f-aa61-4d0e-bb38-ae13dd42fa86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:22.708860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaad2f-aa61-4d0e-bb38-ae13dd42fa86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:22.710412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaad2f-aa61-4d0e-bb38-ae13dd42fa86 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:22.723199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 933/1880] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:22.868785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85014f-b714-48f6-8e22-3c05f86ee4e6 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:22.928077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85014f-b714-48f6-8e22-3c05f86ee4e6 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:22.932757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:22.933640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:22.933919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:22.934220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] PATH_INFO: `/v3/users/dce11682f5ee4a828b91d3f50ed43946` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:22.935556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce11682f5ee4a828b91d3f50ed43946)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:22.937476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:23.200742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce11682f5ee4a828b91d3f50ed43946'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:23.201402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce11682f5ee4a828b91d3f50ed43946'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:23.226290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce11682f5ee4a828b91d3f50ed43946'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:23.322016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce11682f5ee4a828b91d3f50ed43946'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:23.322728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce11682f5ee4a828b91d3f50ed43946'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:23.343975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 948/1881] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:22 2022] DELETE /identity/v3/users/dce11682f5ee4a828b91d3f50ed43946 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:23.349240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:23.350089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:23.350505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:23.368234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:23.369517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:23.431148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 934/1882] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:23.441127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:23.442853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:23.503919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68ff92-bdaa-4dbd-9066-8acf6174e0d1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:23.507552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:23.508204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:23.508487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:23.508759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:23.518071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:23.524186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:23.533800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 949/1883] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:24.174385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:24.176683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:24.196326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84457442-68a5-4e1b-8dcd-8783844d9e25 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:24.203254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:24.204551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:24.204838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:24.205118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] PATH_INFO: `/v3/projects/e1a74f89b5aa4f869a1ca185e935592d` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:24.207036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a74f89b5aa4f869a1ca185e935592d)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:24.209874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:24.404257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a74f89b5aa4f869a1ca185e935592d', 'request_id': 'req-143e414b-405d-472d-937a-74472cbb5031'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.518085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a74f89b5aa4f869a1ca185e935592d', 'request_id': 'req-143e414b-405d-472d-937a-74472cbb5031'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.525006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a74f89b5aa4f869a1ca185e935592d', 'request_id': 'req-143e414b-405d-472d-937a-74472cbb5031'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.537900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] The token cache is being invalidate because project e1a74f89b5aa4f869a1ca185e935592d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:24.538198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.538924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.540560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 935/1884] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:24 2022] DELETE /identity/v3/projects/e1a74f89b5aa4f869a1ca185e935592d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:24.544820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:24.555316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366a61c-68bb-4bbf-adfd-7312e0d74b14 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:24.617672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:24.618545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:24.618854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:24.619129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] PATH_INFO: `/v3/users/6d8233cf65a14b3d9e7baf6a5ae0d251` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:24.620331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8233cf65a14b3d9e7baf6a5ae0d251)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:24.622224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:24.861881 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8233cf65a14b3d9e7baf6a5ae0d251'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.863235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8233cf65a14b3d9e7baf6a5ae0d251'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.870469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8233cf65a14b3d9e7baf6a5ae0d251'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.946706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8233cf65a14b3d9e7baf6a5ae0d251'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.947640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8233cf65a14b3d9e7baf6a5ae0d251'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:24.967724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 950/1885] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:24 2022] DELETE /identity/v3/users/6d8233cf65a14b3d9e7baf6a5ae0d251 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:25.056310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:25.056310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:25.075858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e414b-405d-472d-937a-74472cbb5031 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:25.195999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:25.197053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.197769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.198024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] PATH_INFO: `/v3/users/6d4c15b126d34355a4046288452a2b2e` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.199281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4c15b126d34355a4046288452a2b2e)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:25.201336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:25.474701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4c15b126d34355a4046288452a2b2e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.536686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4c15b126d34355a4046288452a2b2e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.547012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:25.549043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:25.558714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4c15b126d34355a4046288452a2b2e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.559768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4c15b126d34355a4046288452a2b2e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.560655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-952dc3e7-21c6-4172-877f-e2e456108c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4c15b126d34355a4046288452a2b2e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.571681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275bf1-15e3-48fc-85b6-7f01f11f0130 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:25.575034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 936/1886] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:25 2022] DELETE /identity/v3/users/6d4c15b126d34355a4046288452a2b2e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:25.581768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:25.583720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.584595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.585437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] PATH_INFO: `/v3/projects/f8c06c68b1f5464ab57f385443d91e25` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.587137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c06c68b1f5464ab57f385443d91e25)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:25.588097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.588390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.588678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.589563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:25.609782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:25.611202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:25.671411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 937/1887] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:25.681941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:25.683378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:25.736910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c06c68b1f5464ab57f385443d91e25', 'request_id': 'req-274fedde-97c4-4d98-ac47-08b8c85be6d1'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.740948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274a7a-7af0-4fc7-8cc3-650ce4326fb1 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:25.743493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c06c68b1f5464ab57f385443d91e25', 'request_id': 'req-274fedde-97c4-4d98-ac47-08b8c85be6d1'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.788124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ca89e-760a-492a-9441-2988ee268f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:25.788778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca89e-760a-492a-9441-2988ee268f9e service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.789056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca89e-760a-492a-9441-2988ee268f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.789328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca89e-760a-492a-9441-2988ee268f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.831885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c06c68b1f5464ab57f385443d91e25', 'request_id': 'req-274fedde-97c4-4d98-ac47-08b8c85be6d1'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.843709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] The token cache is being invalidate because project f8c06c68b1f5464ab57f385443d91e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:25.844077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.844707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-274fedde-97c4-4d98-ac47-08b8c85be6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:25.846834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 951/1888] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:25 2022] DELETE /identity/v3/projects/f8c06c68b1f5464ab57f385443d91e25 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:25.850231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ca89e-760a-492a-9441-2988ee268f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:25.851737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ca89e-760a-492a-9441-2988ee268f9e service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:25.852024 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01345392-4912-4d83-bd6e-a91672445a3f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.852363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01345392-4912-4d83-bd6e-a91672445a3f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.852643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01345392-4912-4d83-bd6e-a91672445a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.863199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 938/1889] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:25.875291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-01345392-4912-4d83-bd6e-a91672445a3f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:25.876775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-01345392-4912-4d83-bd6e-a91672445a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:25.886488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 952/1890] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:25.894378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6670c-ab32-40ec-a32a-e659c8d12011 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.894718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6670c-ab32-40ec-a32a-e659c8d12011 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.895004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6670c-ab32-40ec-a32a-e659c8d12011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.913724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-68c6670c-ab32-40ec-a32a-e659c8d12011 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:25.914992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-68c6670c-ab32-40ec-a32a-e659c8d12011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:25.923321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 939/1891] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:25.928489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01345392-4912-4d83-bd6e-a91672445a3f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:25.940954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01345392-4912-4d83-bd6e-a91672445a3f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:25.945980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:25.946686 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.946995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.947271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.948026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:25.948341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:25.949957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:25.962718 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 953/1892] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:14:25.967169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6670c-ab32-40ec-a32a-e659c8d12011 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:25.978674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6670c-ab32-40ec-a32a-e659c8d12011 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:25.984344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:25.985145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:25.985511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:25.985883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:25.986732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:25.989389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:26.130866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 940/1893] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:25 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:26.136210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:26.149776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0799f-fec0-4bd3-b3f3-0d07961e9751 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:26.209130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:26.209977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:26.210361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:26.210790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:26.211594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:26.213519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:26.328114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 954/1894] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:26 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:26.329675 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:26.344659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf59a-9efe-426c-b852-49cb26539e22 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:26.350270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:26.358712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:26.358712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:26.358712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:26.362296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:26.363953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:26.392654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 941/1895] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:26.397018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:26.411366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca44c2-624f-4067-b146-48b03debe32d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:26.429148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:26.434162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:26.434162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:26.434162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:26.434162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:26.437038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:26.437553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:26.439557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:26.454203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 955/1896] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:26.455836 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:26.463000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50381f8-efe3-4dbd-83c0-57b60f5f7dbf admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:26.482636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:26.483526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:26.483800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:26.484076 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] PATH_INFO: `/v3/projects/3e74a0c6abfc43ecae35946fbe91cbe8` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:26.485532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caad56a-6a7e-4c48-8b66-c449caaf8e75 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:26.493824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e74a0c6abfc43ecae35946fbe91cbe8)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:26.495860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:26.500489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160513b-39aa-4af4-81a6-bdbe9043f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:26.501793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160513b-39aa-4af4-81a6-bdbe9043f8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:26.503226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160513b-39aa-4af4-81a6-bdbe9043f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:26.503821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160513b-39aa-4af4-81a6-bdbe9043f8cd admin admin] PATH_INFO: `/v3/projects/5e5a1c61a9f14fccb1d77a0c267755b5/users/5b10e094b16f4a71a3aa0126efbc82a6/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:26.527067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160513b-39aa-4af4-81a6-bdbe9043f8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5a1c61a9f14fccb1d77a0c267755b5, user_id=5b10e094b16f4a71a3aa0126efbc82a6, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:26.529943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160513b-39aa-4af4-81a6-bdbe9043f8cd admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:26.618401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 956/1897] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:26 2022] PUT /identity/v3/projects/5e5a1c61a9f14fccb1d77a0c267755b5/users/5b10e094b16f4a71a3aa0126efbc82a6/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:26.632879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26831ae3-f5ff-40a5-ab16-cff1fdc42b2d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:26.633128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26831ae3-f5ff-40a5-ab16-cff1fdc42b2d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:26.634793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e74a0c6abfc43ecae35946fbe91cbe8', 'request_id': 'req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:26.643898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26831ae3-f5ff-40a5-ab16-cff1fdc42b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:26.677783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-26831ae3-f5ff-40a5-ab16-cff1fdc42b2d None None] MFA Rules not processed for user `5b10e094b16f4a71a3aa0126efbc82a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:26.679019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-26831ae3-f5ff-40a5-ab16-cff1fdc42b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:26.750042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 957/1898] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:26.786511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e74a0c6abfc43ecae35946fbe91cbe8', 'request_id': 'req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:26.792429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e74a0c6abfc43ecae35946fbe91cbe8', 'request_id': 'req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:26.804979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] The token cache is being invalidate because project 3e74a0c6abfc43ecae35946fbe91cbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:26.815700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:26.815700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:26.815700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 942/1899] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:26 2022] DELETE /identity/v3/projects/3e74a0c6abfc43ecae35946fbe91cbe8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:26.815976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26831ae3-f5ff-40a5-ab16-cff1fdc42b2d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:26.879318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26831ae3-f5ff-40a5-ab16-cff1fdc42b2d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:26.884516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:26.885397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:26.885676 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:26.885950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] PATH_INFO: `/v3/users/5e89d82f9735418caa0148d58b869e45` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:26.887175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e89d82f9735418caa0148d58b869e45)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:26.889105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:27.054033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:27.055737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:27.118512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972849b3-bcac-4e4f-bb19-08a3d0cfa5bb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:27.123118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eaad8-d309-4961-a645-6acd4c74df67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:27.124006 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eaad8-d309-4961-a645-6acd4c74df67 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:27.124438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eaad8-d309-4961-a645-6acd4c74df67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:27.124859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eaad8-d309-4961-a645-6acd4c74df67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:27.127928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-848eaad8-d309-4961-a645-6acd4c74df67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:27.142430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eaad8-d309-4961-a645-6acd4c74df67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:27.145244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eaad8-d309-4961-a645-6acd4c74df67 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:27.157296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 943/1900] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:27.282484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e89d82f9735418caa0148d58b869e45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:27.283216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e89d82f9735418caa0148d58b869e45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:27.290502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e89d82f9735418caa0148d58b869e45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:27.440371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a42c-9084-465c-85bc-3e390013293e None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:27.440658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a42c-9084-465c-85bc-3e390013293e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:27.440936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a42c-9084-465c-85bc-3e390013293e None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:27.442799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 944/1901] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 31 18:14:27.459236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:27.459523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:27.459799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:27.477440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e89d82f9735418caa0148d58b869e45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:27.478079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e89d82f9735418caa0148d58b869e45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:27.486970 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:27.488354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:27.503826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 958/1902] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:26 2022] DELETE /identity/v3/users/5e89d82f9735418caa0148d58b869e45 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:27.584078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 945/1903] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:14:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:27.747397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:27.749539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:27.845017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf39686-ad21-46bd-844b-be8e59aea365 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:27.852375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727f7a6-aca7-423a-82dd-b76e74c9396e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:27.853185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f7a6-aca7-423a-82dd-b76e74c9396e service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:27.853788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f7a6-aca7-423a-82dd-b76e74c9396e service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:27.854212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f7a6-aca7-423a-82dd-b76e74c9396e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:27.868075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727f7a6-aca7-423a-82dd-b76e74c9396e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:27.870732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727f7a6-aca7-423a-82dd-b76e74c9396e service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:27.899622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 959/1904] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:28.081042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:28.082735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:28.107789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4413fde-4fdf-4649-b515-c287555c1efc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:28.223538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:28.224513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:28.224995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:28.225469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] PATH_INFO: `/v3/projects/5efe8d9fb9b548f0a6d1bd46af75f6d4` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:28.227053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efe8d9fb9b548f0a6d1bd46af75f6d4)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:28.229343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:28.465378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efe8d9fb9b548f0a6d1bd46af75f6d4', 'request_id': 'req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:28.643804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efe8d9fb9b548f0a6d1bd46af75f6d4', 'request_id': 'req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:28.650391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efe8d9fb9b548f0a6d1bd46af75f6d4', 'request_id': 'req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:28.662997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] The token cache is being invalidate because project 5efe8d9fb9b548f0a6d1bd46af75f6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:28.663288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:28.663956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:28.665906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 946/1905] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:28 2022] DELETE /identity/v3/projects/5efe8d9fb9b548f0a6d1bd46af75f6d4 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:28.670828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142213-3260-4688-ab34-4653a930c7c9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:28.671118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142213-3260-4688-ab34-4653a930c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:28.671795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142213-3260-4688-ab34-4653a930c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:28.691932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-32142213-3260-4688-ab34-4653a930c7c9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:28.693002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:28.693160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-32142213-3260-4688-ab34-4653a930c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:28.694837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:28.765436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 960/1906] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:28.775105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06495c2-ca6c-4316-8af5-bf90d00abb60 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:28.775399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06495c2-ca6c-4316-8af5-bf90d00abb60 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:28.775677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06495c2-ca6c-4316-8af5-bf90d00abb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:28.780352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b2ffc-2650-419d-ae1a-5d1fac691a98 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:28.788468 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:28.789643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:28.789923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:28.790700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] PATH_INFO: `/v3/users/c1e181ce79ed4d43b4549f77a8972642` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:28.792143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e181ce79ed4d43b4549f77a8972642)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:28.794495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:28.813266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b06495c2-ca6c-4316-8af5-bf90d00abb60 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:28.815323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b06495c2-ca6c-4316-8af5-bf90d00abb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:28.827194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 961/1907] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:28.828167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06495c2-ca6c-4316-8af5-bf90d00abb60 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:28.838360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06495c2-ca6c-4316-8af5-bf90d00abb60 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:28.843147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:28.843992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:28.844280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:28.844712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:28.845454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:28.846985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:28.848648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:28.861219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 962/1908] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:14:28.866145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:28.876547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb145-24d2-4692-82e5-4b01c7489a77 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:28.882351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:28.883036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:28.883316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:28.883587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:28.884285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:28.886279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.006345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 963/1909] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:28 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:29.007169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.051212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e181ce79ed4d43b4549f77a8972642'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:29.077740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc5bed-b040-4a82-b00e-65257d52a9f6 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:29.082795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:29.083503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.083792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.084092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.084822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:29.086835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.137906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e181ce79ed4d43b4549f77a8972642'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:29.150593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e181ce79ed4d43b4549f77a8972642'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:29.151264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e181ce79ed4d43b4549f77a8972642'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:29.151866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3254b8fd-91bb-4111-8aa8-dcabcb894cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e181ce79ed4d43b4549f77a8972642'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:29.164605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 947/1910] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:28 2022] DELETE /identity/v3/users/c1e181ce79ed4d43b4549f77a8972642 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:29.169346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.169467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 964/1911] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:29 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:29.169879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.170167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.173271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.175579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:29.187898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d74cf-4129-4771-b441-0f98ade9e0a3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:29.189154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:29.191126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:29.249267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:29.249942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.250286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.250495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.251396 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:29.253540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.257289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 948/1912] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:29.266861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 965/1913] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:29.267079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.267079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:29.268752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.285926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee557c9-d1ec-4c31-9008-7e6211e8a973 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:29.293344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:29.294262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.294631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.294986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.295802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:29.297531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.312980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 966/1914] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:29.318272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.333017 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bfb4e-dde6-496d-b853-0b32ba62d5d9 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:29.333358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6dd0-55d3-4a7d-8743-fb714e10dfcc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:29.337303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e49c9-6542-4092-9258-8355ad22f3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:29.338031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e49c9-6542-4092-9258-8355ad22f3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.338381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e49c9-6542-4092-9258-8355ad22f3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.338769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:29.338887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e49c9-6542-4092-9258-8355ad22f3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.340009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.340009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.340302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] PATH_INFO: `/v3/projects/d70fc06d04b9474ca9a759ee0e49f1a6/users/b802088bf7ad44b2b3884aaa7151f80d/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.355856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e49c9-6542-4092-9258-8355ad22f3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:29.363769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e49c9-6542-4092-9258-8355ad22f3d9 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.363850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70fc06d04b9474ca9a759ee0e49f1a6, user_id=b802088bf7ad44b2b3884aaa7151f80d, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:29.363850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.379089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 949/1915] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:29.528794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 967/1916] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:29 2022] PUT /identity/v3/projects/d70fc06d04b9474ca9a759ee0e49f1a6/users/b802088bf7ad44b2b3884aaa7151f80d/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:29.539777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2344-5c09-4391-a88e-7f635405b39e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.540072 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2344-5c09-4391-a88e-7f635405b39e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.540641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2344-5c09-4391-a88e-7f635405b39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.568551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-dacd2344-5c09-4391-a88e-7f635405b39e None None] MFA Rules not processed for user `b802088bf7ad44b2b3884aaa7151f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:29.569742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dacd2344-5c09-4391-a88e-7f635405b39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:29.634175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 950/1917] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:29.749283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.751010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:29.810028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc7174-8149-417b-9c7b-667ee9cd1fde admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:29.813757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:29.814575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.815091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.815376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.824319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:29.825774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.836217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 968/1918] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:29.856538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2344-5c09-4391-a88e-7f635405b39e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.920855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2344-5c09-4391-a88e-7f635405b39e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:29.926002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:29.927059 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:29.927346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:29.927621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] PATH_INFO: `/v3/users/b802088bf7ad44b2b3884aaa7151f80d` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:29.928821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b802088bf7ad44b2b3884aaa7151f80d)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:29.930759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:29.981455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:29.982946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:30.010100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bcae1-c78d-458e-b7f0-c0beb7d95ae8 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:30.034495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:30.035586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:30.035878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:30.036160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] PATH_INFO: `/v3/projects/781f671cf30b4b0599cc9b8d9336961d` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:30.039453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781f671cf30b4b0599cc9b8d9336961d)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:30.042842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:30.226214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b802088bf7ad44b2b3884aaa7151f80d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.234284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781f671cf30b4b0599cc9b8d9336961d', 'request_id': 'req-adead6a8-a61b-4c4a-9d01-c68918264d45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.242478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781f671cf30b4b0599cc9b8d9336961d', 'request_id': 'req-adead6a8-a61b-4c4a-9d01-c68918264d45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.320531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b802088bf7ad44b2b3884aaa7151f80d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.332334 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b802088bf7ad44b2b3884aaa7151f80d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.332955 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b802088bf7ad44b2b3884aaa7151f80d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.333545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d034294d-0638-40b5-a726-23563b91016d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b802088bf7ad44b2b3884aaa7151f80d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.346693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 951/1919] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:29 2022] DELETE /identity/v3/users/b802088bf7ad44b2b3884aaa7151f80d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:30.351262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:30.351554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:30.351843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:30.369895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:30.371145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:30.438989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 952/1920] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:30.448800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:30.450424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:30.464086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781f671cf30b4b0599cc9b8d9336961d', 'request_id': 'req-adead6a8-a61b-4c4a-9d01-c68918264d45'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.477839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] The token cache is being invalidate because project 781f671cf30b4b0599cc9b8d9336961d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:30.478122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.478883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.480531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 969/1921] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:29 2022] DELETE /identity/v3/projects/781f671cf30b4b0599cc9b8d9336961d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:30.485232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:30.486730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:30.521160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6e2d-be59-4071-8716-0e8a3b38bb6c None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:30.526447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:30.527166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:30.527451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:30.527727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:30.529681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:30.543549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:30.545639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:30.561545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 953/1922] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:30.563545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adead6a8-a61b-4c4a-9d01-c68918264d45 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:30.571013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:30.572248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:30.572626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:30.573137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] PATH_INFO: `/v3/users/e06e7bb4971a486ba87a781b5da03f76` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:30.574489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06e7bb4971a486ba87a781b5da03f76)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:30.576845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:30.893524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06e7bb4971a486ba87a781b5da03f76'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.894168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06e7bb4971a486ba87a781b5da03f76'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.902640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06e7bb4971a486ba87a781b5da03f76'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.985736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06e7bb4971a486ba87a781b5da03f76'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:30.990552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-edec6425-2ff8-4e14-a594-21bb52f8bb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06e7bb4971a486ba87a781b5da03f76'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:31.009529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 970/1923] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:30 2022] DELETE /identity/v3/users/e06e7bb4971a486ba87a781b5da03f76 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:31.126470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:31.130130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:31.154325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c3e5-de82-4dde-a6fc-0dda135779a0 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:31.289064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:31.290422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:31.290831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:31.291066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] PATH_INFO: `/v3/projects/d70fc06d04b9474ca9a759ee0e49f1a6` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:31.294824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70fc06d04b9474ca9a759ee0e49f1a6)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:31.296756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:31.492258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70fc06d04b9474ca9a759ee0e49f1a6', 'request_id': 'req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:31.620622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70fc06d04b9474ca9a759ee0e49f1a6', 'request_id': 'req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:31.645793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70fc06d04b9474ca9a759ee0e49f1a6', 'request_id': 'req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:31.664303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] The token cache is being invalidate because project d70fc06d04b9474ca9a759ee0e49f1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:31.664303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:31.664303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:31.664303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 954/1924] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:31 2022] DELETE /identity/v3/projects/d70fc06d04b9474ca9a759ee0e49f1a6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:31.668104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d4a9c-b781-40a5-a637-6cd81a1c9b41 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:31.668392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d4a9c-b781-40a5-a637-6cd81a1c9b41 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:31.668669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d4a9c-b781-40a5-a637-6cd81a1c9b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:31.686866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8b3d4a9c-b781-40a5-a637-6cd81a1c9b41 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:31.688204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8b3d4a9c-b781-40a5-a637-6cd81a1c9b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:31.736995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:31.738375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:31.754685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 971/1925] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:31.763481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ce30-86ad-4a49-b25d-295c1449d753 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:31.763839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ce30-86ad-4a49-b25d-295c1449d753 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:31.764191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ce30-86ad-4a49-b25d-295c1449d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:31.785698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1195ce30-86ad-4a49-b25d-295c1449d753 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:31.787038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1195ce30-86ad-4a49-b25d-295c1449d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:31.796049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 972/1926] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:31.800537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195ce30-86ad-4a49-b25d-295c1449d753 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:31.810479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195ce30-86ad-4a49-b25d-295c1449d753 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:31.819452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:31.820262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:31.820547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:31.820822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:31.821966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:31.822297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:31.822912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b68b7-d8a2-4b8b-9f90-7b933d3a90d7 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:31.824275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:31.828220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:31.829373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:31.830085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:31.830679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] PATH_INFO: `/v3/projects/6413c98c794d4655a3db1d02679acaf8` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:31.832142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6413c98c794d4655a3db1d02679acaf8)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:31.834291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:31.837472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 973/1927] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:14:31.842221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:31.857125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf759c-a1c1-4a73-bd67-76af92fc0476 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:31.863922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:31.864580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:31.864859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:31.865135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:31.865829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:31.867811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:31.974575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6413c98c794d4655a3db1d02679acaf8', 'request_id': 'req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:31.986796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 974/1928] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:31 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:31.990853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.054905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6db350-03e2-405c-a44a-dcc3a371c641 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.060368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.061096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.061370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.061649 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.062335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.064938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.071012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6413c98c794d4655a3db1d02679acaf8', 'request_id': 'req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:32.076873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6413c98c794d4655a3db1d02679acaf8', 'request_id': 'req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:32.089202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] The token cache is being invalidate because project 6413c98c794d4655a3db1d02679acaf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:32.089495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:32.090177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fe0ed8c8-6f9a-4b65-8e80-c9c5528dabf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:32.091862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 955/1929] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:31 2022] DELETE /identity/v3/projects/6413c98c794d4655a3db1d02679acaf8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:32.096686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa76a-ae16-4341-aeca-940f0a0ae582 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.097009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa76a-ae16-4341-aeca-940f0a0ae582 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.097296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa76a-ae16-4341-aeca-940f0a0ae582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.116988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0a8aa76a-ae16-4341-aeca-940f0a0ae582 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:32.119182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0a8aa76a-ae16-4341-aeca-940f0a0ae582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:32.127812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 956/1930] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:32.136354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245dfd8-5e93-4a99-8363-7b281b7715ca None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.136638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245dfd8-5e93-4a99-8363-7b281b7715ca None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.141186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245dfd8-5e93-4a99-8363-7b281b7715ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.155528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2245dfd8-5e93-4a99-8363-7b281b7715ca None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:32.156896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2245dfd8-5e93-4a99-8363-7b281b7715ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:32.169162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 957/1931] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:32.169969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245dfd8-5e93-4a99-8363-7b281b7715ca None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.172805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 975/1932] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:31 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:32.177010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.179067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:32.179937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245dfd8-5e93-4a99-8363-7b281b7715ca None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.186777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.187491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.187781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.188061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.189449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:32.189761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.191423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.192654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0805d3-32b8-419e-822d-0605eb7edda0 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.198996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.199793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.200207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.200562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.202998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.208281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 958/1933] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:14:32.208536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.209241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.216259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 976/1934] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:32.220422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398065eb-b2e1-4c03-94eb-c13af3c814ca admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.226457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.227352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.228099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.228468 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.228812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.229633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.231697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.236516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392aab3-17c0-412f-955d-63ed20014984 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.242035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.242919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.243201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.243471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.244233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.245817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.257229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 977/1935] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:32.261299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.272160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f50e0-8e28-427f-8596-6483d902320e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.276867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec64805-c234-4ef9-a63b-1ce593db7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.277738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64805-c234-4ef9-a63b-1ce593db7ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.278022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64805-c234-4ef9-a63b-1ce593db7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.278333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64805-c234-4ef9-a63b-1ce593db7ee9 admin admin] PATH_INFO: `/v3/projects/854e7bd7838b48eeaca75aaf2311dd21/users/92e9b195f18d47819308a1132b7fa936/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.293522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec64805-c234-4ef9-a63b-1ce593db7ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854e7bd7838b48eeaca75aaf2311dd21, user_id=92e9b195f18d47819308a1132b7fa936, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.296233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec64805-c234-4ef9-a63b-1ce593db7ee9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.406781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 978/1936] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:32 2022] PUT /identity/v3/projects/854e7bd7838b48eeaca75aaf2311dd21/users/92e9b195f18d47819308a1132b7fa936/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:32.408893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 959/1937] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:32 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:32.417680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.418118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.418403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.418820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.449471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] MFA Rules not processed for user `92e9b195f18d47819308a1132b7fa936`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:32.450747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:32.488492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28979cb-386e-4ddc-9430-281051af7dc4 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.493792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.495060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.495060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.495314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.495947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.498054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.541677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 979/1938] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:32.557890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.560661 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:32.580318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 960/1939] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:32 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:32.587022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.602274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5190-8b10-4ed7-ba23-475aadc110a7 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.611298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.614347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.615553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.615924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.618331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.621343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.643455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 961/1940] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:32.644667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.649316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345e98b-72c7-4644-845b-0d08e3bf50f7 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.653430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.654089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.654368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.654684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.657595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c99010-0a74-4d13-a143-972fc82d1595 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.663558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.665195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.665817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.666475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.666828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.667229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.668285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.670183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.680365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 980/1941] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:14:32.691097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 962/1942] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:32.692573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.710833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f716b-8438-4507-8f91-ffb828e5b0d4 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.721036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26483f-1d0b-45f4-a1b7-c2e54db4c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.722027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26483f-1d0b-45f4-a1b7-c2e54db4c3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.722310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26483f-1d0b-45f4-a1b7-c2e54db4c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.722587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26483f-1d0b-45f4-a1b7-c2e54db4c3e7 admin admin] PATH_INFO: `/v3/projects/92cbf027ed994b2da86041820afa7b35/users/ddfa8498157b4fe198e83da05ed780b4/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.742176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26483f-1d0b-45f4-a1b7-c2e54db4c3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cbf027ed994b2da86041820afa7b35, user_id=ddfa8498157b4fe198e83da05ed780b4, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.744916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26483f-1d0b-45f4-a1b7-c2e54db4c3e7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.797793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.800305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:32.812881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473448c-d8cf-4f76-bb0d-2f171b960f27 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:32.817860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:32.819229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.819510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.819820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] PATH_INFO: `/v3/users/e3ac39da183d430caf03fc4bc40351b8` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.821086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ac39da183d430caf03fc4bc40351b8)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:32.823200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:32.864184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 981/1943] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:32 2022] PUT /identity/v3/projects/92cbf027ed994b2da86041820afa7b35/users/ddfa8498157b4fe198e83da05ed780b4/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:32.869473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:32.869766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:32.870049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:32.887132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:32.888329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:32.955432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 982/1944] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:32.961990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:32.963416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:33.020705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922daa8-c906-49ec-a7b6-0044e09c5b1f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:33.024814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ae9db-9c98-4377-b029-2087cda72613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:33.025556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ae9db-9c98-4377-b029-2087cda72613 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:33.025913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ae9db-9c98-4377-b029-2087cda72613 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:33.026251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ae9db-9c98-4377-b029-2087cda72613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:33.037889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ae9db-9c98-4377-b029-2087cda72613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:33.039468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ae9db-9c98-4377-b029-2087cda72613 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:33.051181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 983/1945] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:33.090291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ac39da183d430caf03fc4bc40351b8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:33.217011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ac39da183d430caf03fc4bc40351b8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:33.229283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ac39da183d430caf03fc4bc40351b8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:33.229970 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ac39da183d430caf03fc4bc40351b8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:33.230646 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ac39da183d430caf03fc4bc40351b8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:33.243235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 963/1946] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:32 2022] DELETE /identity/v3/users/e3ac39da183d430caf03fc4bc40351b8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:33.247676 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:33.248010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:33.248238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:33.265643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:33.267369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:33.328220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 984/1947] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:33.338525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:33.340312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:33.427233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e70c7-8b13-41d5-a5fe-6354e10075d9 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:33.431283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:33.432101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:33.440064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:33.440064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:33.442989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:33.444438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:33.454741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 964/1948] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:34.022738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:34.022738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:34.034407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa5818-a0cf-4414-889e-eff5c45fda22 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:34.040630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:34.041482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:34.041767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:34.042070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] PATH_INFO: `/v3/projects/4bb3fcb9d485410bb2fe66c7262301b0` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:34.043327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb3fcb9d485410bb2fe66c7262301b0)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:34.045286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:34.195999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb3fcb9d485410bb2fe66c7262301b0', 'request_id': 'req-36d2fac3-0ad7-4030-830c-70fcef353eda'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.201465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb3fcb9d485410bb2fe66c7262301b0', 'request_id': 'req-36d2fac3-0ad7-4030-830c-70fcef353eda'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.293220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb3fcb9d485410bb2fe66c7262301b0', 'request_id': 'req-36d2fac3-0ad7-4030-830c-70fcef353eda'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.305240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] The token cache is being invalidate because project 4bb3fcb9d485410bb2fe66c7262301b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:34.305528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.306541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-36d2fac3-0ad7-4030-830c-70fcef353eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.307820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 985/1949] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:34 2022] DELETE /identity/v3/projects/4bb3fcb9d485410bb2fe66c7262301b0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:34.311665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:34.322060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c1438-4ef4-442a-b1fc-f3191771eed5 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:34.379525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:34.380414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:34.380697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:34.380964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] PATH_INFO: `/v3/users/90875f57f6bb458da19b26e0ae994057` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:34.382188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90875f57f6bb458da19b26e0ae994057)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:34.384250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:34.655668 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90875f57f6bb458da19b26e0ae994057'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.779056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90875f57f6bb458da19b26e0ae994057'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.792836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90875f57f6bb458da19b26e0ae994057'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.793542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90875f57f6bb458da19b26e0ae994057'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.794148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90875f57f6bb458da19b26e0ae994057'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:34.798170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558766-5b48-4729-aea9-faa4de06c13f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:34.798687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558766-5b48-4729-aea9-faa4de06c13f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:34.799203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558766-5b48-4729-aea9-faa4de06c13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:34.807773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 965/1950] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:34 2022] DELETE /identity/v3/users/90875f57f6bb458da19b26e0ae994057 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:34.828030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-21558766-5b48-4729-aea9-faa4de06c13f None None] MFA Rules not processed for user `ddfa8498157b4fe198e83da05ed780b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:34.829366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-21558766-5b48-4729-aea9-faa4de06c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:34.926519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 986/1951] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:34.930958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:34.932518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:35.009632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba2cab-bd94-440c-9699-96b77f0f4fc5 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.014469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.015177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.015457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.015736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.016814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.018890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.139414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 966/1952] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:34 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:35.155376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558766-5b48-4729-aea9-faa4de06c13f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.169889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558766-5b48-4729-aea9-faa4de06c13f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.228797 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.229485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.229770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.230045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.230792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.232702 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.363554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 987/1953] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:35 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:35.364912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.375788 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206315-7d55-4600-b0c6-c416f981bde0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.380674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.381346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.381627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.381902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.382644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.384275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.395653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 967/1954] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:35.399722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.410249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2fd2-269c-4272-b998-5c892a7e3829 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.415260 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.416147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.416424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.416696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] PATH_INFO: `/v3/projects/5d1721b4b84c4f86b3c28efdba42d6e7/users/5e46c73c3c44435e86bf75055bea0cb8/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.423376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.426234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:35.447120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d63f6-46b4-425e-8b61-cdcebcdeb959 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.449625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1721b4b84c4f86b3c28efdba42d6e7, user_id=5e46c73c3c44435e86bf75055bea0cb8, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.453332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.455136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.455631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.455873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.456265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] PATH_INFO: `/v3/projects/3b2cd0d27ec84af387e537c7a6f67820` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.458169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2cd0d27ec84af387e537c7a6f67820)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.461447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.585729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 988/1955] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:35 2022] PUT /identity/v3/projects/5d1721b4b84c4f86b3c28efdba42d6e7/users/5e46c73c3c44435e86bf75055bea0cb8/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:35.589670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.622142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2cd0d27ec84af387e537c7a6f67820', 'request_id': 'req-8b9d990e-8317-4c86-89ec-eff5e47e9f17'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:35.651947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6c2ba-7976-4dcd-9156-47d027f2782e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.693077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2cd0d27ec84af387e537c7a6f67820', 'request_id': 'req-8b9d990e-8317-4c86-89ec-eff5e47e9f17'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:35.699097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2cd0d27ec84af387e537c7a6f67820', 'request_id': 'req-8b9d990e-8317-4c86-89ec-eff5e47e9f17'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:35.710171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.710587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] The token cache is being invalidate because project 3b2cd0d27ec84af387e537c7a6f67820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:14:35.710883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.710990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:35.711160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.711432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.711587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b9d990e-8317-4c86-89ec-eff5e47e9f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:35.712158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.713147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 968/1956] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:35 2022] DELETE /identity/v3/projects/3b2cd0d27ec84af387e537c7a6f67820 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:35.715267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.717739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df2fcc-00d2-46df-84b0-5dccd069af01 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.718027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df2fcc-00d2-46df-84b0-5dccd069af01 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.718304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df2fcc-00d2-46df-84b0-5dccd069af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.729390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 989/1957] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:35.730446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.732308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:35.739068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-06df2fcc-00d2-46df-84b0-5dccd069af01 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:35.740226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-06df2fcc-00d2-46df-84b0-5dccd069af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:35.746281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dfbeb-fc3f-4a3b-9fac-f38932313c43 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.748258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 969/1958] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:35.751894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.752788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.753073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.753353 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] PATH_INFO: `/v3/projects/5d1721b4b84c4f86b3c28efdba42d6e7/users/5e46c73c3c44435e86bf75055bea0cb8/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.755624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1721b4b84c4f86b3c28efdba42d6e7, user_id=5e46c73c3c44435e86bf75055bea0cb8, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.755879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf6bb-fa9b-42ee-99cf-fea06bd1e1f7 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.756167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf6bb-fa9b-42ee-99cf-fea06bd1e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.756435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf6bb-fa9b-42ee-99cf-fea06bd1e1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.758333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.772621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 990/1959] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:35 2022] PUT /identity/v3/projects/5d1721b4b84c4f86b3c28efdba42d6e7/users/5e46c73c3c44435e86bf75055bea0cb8/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:35.774170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6e2bf6bb-fa9b-42ee-99cf-fea06bd1e1f7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:35.775404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6e2bf6bb-fa9b-42ee-99cf-fea06bd1e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:35.847509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 970/1960] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:14:35.852317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.862984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27f2ab-5a01-46fa-9221-748829b221a0 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.867644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.868305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.870400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.870400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.870400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:14:35.870400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.871544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:35.886318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 991/1961] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:14:35.890538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf6bb-fa9b-42ee-99cf-fea06bd1e1f7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:35.901150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf6bb-fa9b-42ee-99cf-fea06bd1e1f7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:35.906189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:35.907771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:35.908123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:35.908631 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:35.909274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:35.911343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:36.110316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 971/1962] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:35 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:36.114878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:36.124910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343d68d-1b3d-4e55-9ad5-22c7cbc404ba admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:36.193601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:36.194276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:36.194544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:36.194853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:36.195618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:36.197531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:36.375257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 992/1963] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:36 2022] POST /identity/v3/users => generated 282 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:36.379309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:36.397641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa476f0d-e881-4efe-a8fa-f510241ae1a6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:36.414657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:36.415674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:36.416107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:36.425629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:36.425629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:36.425629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:36.449554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 972/1964] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:36.454971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:36.477513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157d701-ac66-4c4e-9d24-78fef35dd465 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:36.483122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b455b78-e41e-47b4-ab99-276657b4493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:36.485167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455b78-e41e-47b4-ab99-276657b4493e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:36.485622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455b78-e41e-47b4-ab99-276657b4493e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:36.486078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455b78-e41e-47b4-ab99-276657b4493e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:36.486860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b455b78-e41e-47b4-ab99-276657b4493e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:36.488641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b455b78-e41e-47b4-ab99-276657b4493e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:36.500843 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 993/1965] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:14:36.508284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:36.521066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b224-0004-473f-920e-b531fcf14c95 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:36.527654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:36.528606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:36.528894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:36.533302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] PATH_INFO: `/v3/projects/c759ce11077644b6a806d5c605b2cfcb/users/201ecf38ebda4bc985a46fd54ec6ac80/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:36.546467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c759ce11077644b6a806d5c605b2cfcb, user_id=201ecf38ebda4bc985a46fd54ec6ac80, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:36.550179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:36.773903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 973/1966] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:36 2022] PUT /identity/v3/projects/c759ce11077644b6a806d5c605b2cfcb/users/201ecf38ebda4bc985a46fd54ec6ac80/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:36.785179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e56a-efc4-4c8c-a78f-3490cedcc79d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:36.785483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e56a-efc4-4c8c-a78f-3490cedcc79d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:36.785945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0e56a-efc4-4c8c-a78f-3490cedcc79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:36.816423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-11e0e56a-efc4-4c8c-a78f-3490cedcc79d None None] MFA Rules not processed for user `201ecf38ebda4bc985a46fd54ec6ac80`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:36.817627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-11e0e56a-efc4-4c8c-a78f-3490cedcc79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:36.905151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 994/1967] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:36.917732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:36.992418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd75e5c-5a31-4a98-b514-f0d3bb7d7bc4 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:36.997434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:36.998236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:36.998512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:36.998822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:36.999526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:37.001671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:37.145333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 974/1968] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:14:36 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:14:37.149704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0e56a-efc4-4c8c-a78f-3490cedcc79d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:37.165070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0e56a-efc4-4c8c-a78f-3490cedcc79d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:37.258999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:37.259704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:37.259956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:37.260232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:37.261319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:37.263252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:37.425028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 995/1969] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:14:37 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:14:37.429103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:37.440309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd3ba-92bc-4e73-a6c0-c47321895eab admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:37.445005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:37.445750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:37.446163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:37.446500 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:37.447340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:37.449295 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:37.462227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 975/1970] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:37.469821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:37.479713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec22f05-2c90-4e8a-b118-1837bfe3955c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:37.487798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:37.488703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:37.488995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:37.489264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] PATH_INFO: `/v3/projects/ab63e6156c6d42a7968cee78a22934e6/users/af544ff3f9bb4657994a8043f78648a9/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:37.509486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab63e6156c6d42a7968cee78a22934e6, user_id=af544ff3f9bb4657994a8043f78648a9, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:37.509654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:37.641383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 996/1971] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:37 2022] PUT /identity/v3/projects/ab63e6156c6d42a7968cee78a22934e6/users/af544ff3f9bb4657994a8043f78648a9/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:14:37.647454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:37.661019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f83ca-9a42-47e0-8214-da50c467081a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:37.724381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e905d-dd4a-46f3-9e0f-77b0ce1cf2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:37.725139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e905d-dd4a-46f3-9e0f-77b0ce1cf2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:37.725507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e905d-dd4a-46f3-9e0f-77b0ce1cf2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:37.725841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e905d-dd4a-46f3-9e0f-77b0ce1cf2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:37.726686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e905d-dd4a-46f3-9e0f-77b0ce1cf2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:37.728401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e905d-dd4a-46f3-9e0f-77b0ce1cf2bd admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:37.739205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 976/1972] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:14:37.743586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:37.755557 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e940e8-2596-42a0-98f8-23da2ec7a71d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:37.761231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b001f79-cf72-412e-9595-40d62ab494f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:37.762124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001f79-cf72-412e-9595-40d62ab494f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:37.762562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001f79-cf72-412e-9595-40d62ab494f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:37.763016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001f79-cf72-412e-9595-40d62ab494f1 admin admin] PATH_INFO: `/v3/projects/ab63e6156c6d42a7968cee78a22934e6/users/af544ff3f9bb4657994a8043f78648a9/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:37.765181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b001f79-cf72-412e-9595-40d62ab494f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab63e6156c6d42a7968cee78a22934e6, user_id=af544ff3f9bb4657994a8043f78648a9, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:37.768856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b001f79-cf72-412e-9595-40d62ab494f1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:37.781060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 997/1973] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:14:37 2022] PUT /identity/v3/projects/ab63e6156c6d42a7968cee78a22934e6/users/af544ff3f9bb4657994a8043f78648a9/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:37.793609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:37.794138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:37.794571 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:37.863922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] MFA Rules not processed for user `af544ff3f9bb4657994a8043f78648a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:37.867129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:38.028910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 977/1974] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:38.048563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6eab-9255-43d6-a7b6-905b9f54c60f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:38.048985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6eab-9255-43d6-a7b6-905b9f54c60f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:38.053050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6eab-9255-43d6-a7b6-905b9f54c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:38.054587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:38.056162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:38.089828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-dbad6eab-9255-43d6-a7b6-905b9f54c60f None None] MFA Rules not processed for user `5e46c73c3c44435e86bf75055bea0cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:38.091634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-dbad6eab-9255-43d6-a7b6-905b9f54c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:38.134149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552513a3-1e17-4830-8849-74a8845279a4 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:38.138019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:38.138881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:38.139310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:38.139732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:38.161900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:38.161900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:38.164903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 978/1975] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:38.176575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 998/1976] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:38.266296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:38.266296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:38.275994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d083-98c2-499b-b5f5-f5a1bfa75ac6 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:38.285427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:38.286034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:38.286317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:38.286795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:38.288892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:38.350872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:38.352423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:38.362722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 979/1977] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:38.450415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6eab-9255-43d6-a7b6-905b9f54c60f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:38.462049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6eab-9255-43d6-a7b6-905b9f54c60f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:38.466407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:38.467094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:38.467378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:38.467655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:38.527727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:38.529168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:38.538313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 999/1978] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:45.513399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:45.523644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8fbd8-43c0-4591-94c4-54a5daed69d4 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:45.527979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e36c3-ea31-470b-8d32-74d73948c161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:45.528948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e36c3-ea31-470b-8d32-74d73948c161 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:45.529331 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e36c3-ea31-470b-8d32-74d73948c161 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:45.530450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e36c3-ea31-470b-8d32-74d73948c161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:45.541342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e36c3-ea31-470b-8d32-74d73948c161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:45.542919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e36c3-ea31-470b-8d32-74d73948c161 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:45.568256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 980/1979] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:58.709113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:58.710727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:58.775234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3dbe-e175-4070-b7e1-b6a23094b54c service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:58.779796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:58.780669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:58.780952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:58.781226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] PATH_INFO: `/v3/users/5b10e094b16f4a71a3aa0126efbc82a6` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:58.782458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b10e094b16f4a71a3aa0126efbc82a6)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:58.784406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:59.016356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b10e094b16f4a71a3aa0126efbc82a6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:59.017005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b10e094b16f4a71a3aa0126efbc82a6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:59.023697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b10e094b16f4a71a3aa0126efbc82a6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:59.125632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b10e094b16f4a71a3aa0126efbc82a6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:59.126258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b10e094b16f4a71a3aa0126efbc82a6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:14:59.143392 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1000/1980] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:14:58 2022] DELETE /identity/v3/users/5b10e094b16f4a71a3aa0126efbc82a6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:14:59.147925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:59.148452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:59.148550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:59.165655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:14:59.166825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:59.223989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 981/1981] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:14:59.234257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:59.235787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:59.290856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75a96-24c1-429b-99e4-9c04cf2fa82e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:59.295321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd77187-3e3e-4622-97b3-da834f01d07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:59.296005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77187-3e3e-4622-97b3-da834f01d07f service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:59.296287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77187-3e3e-4622-97b3-da834f01d07f service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:59.296562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77187-3e3e-4622-97b3-da834f01d07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:59.305662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd77187-3e3e-4622-97b3-da834f01d07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:59.307207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd77187-3e3e-4622-97b3-da834f01d07f service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:14:59.317537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1001/1982] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:14:59.939208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:14:59.939208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:14:59.956886 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728532-26b7-4f45-8af3-c17611121e3d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:14:59.962116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:14:59.963378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:14:59.963661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:14:59.964580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] PATH_INFO: `/v3/projects/5e5a1c61a9f14fccb1d77a0c267755b5` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:14:59.973988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5a1c61a9f14fccb1d77a0c267755b5)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:14:59.973988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:00.095287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5a1c61a9f14fccb1d77a0c267755b5', 'request_id': 'req-88436fca-deff-4236-825f-04199d7a8290'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:00.170989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5a1c61a9f14fccb1d77a0c267755b5', 'request_id': 'req-88436fca-deff-4236-825f-04199d7a8290'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:00.176968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5a1c61a9f14fccb1d77a0c267755b5', 'request_id': 'req-88436fca-deff-4236-825f-04199d7a8290'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:00.188835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] The token cache is being invalidate because project 5e5a1c61a9f14fccb1d77a0c267755b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:00.189129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:00.189871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88436fca-deff-4236-825f-04199d7a8290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:00.191458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 982/1983] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:14:59 2022] DELETE /identity/v3/projects/5e5a1c61a9f14fccb1d77a0c267755b5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:00.196321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1d9d-f05b-4b43-b230-fd5132f87a41 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.196773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1d9d-f05b-4b43-b230-fd5132f87a41 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.196920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1d9d-f05b-4b43-b230-fd5132f87a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.215568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-024e1d9d-f05b-4b43-b230-fd5132f87a41 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:00.216735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-024e1d9d-f05b-4b43-b230-fd5132f87a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:00.276853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1002/1984] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:00.286149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f834-a717-4edb-a5a9-9d4ab31d1c51 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.286149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f834-a717-4edb-a5a9-9d4ab31d1c51 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.286149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f834-a717-4edb-a5a9-9d4ab31d1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.304942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c172f834-a717-4edb-a5a9-9d4ab31d1c51 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:00.306312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c172f834-a717-4edb-a5a9-9d4ab31d1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:00.314806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 983/1985] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:00.318861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1d9d-f05b-4b43-b230-fd5132f87a41 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:00.331330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1d9d-f05b-4b43-b230-fd5132f87a41 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:00.336421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:00.337233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.337376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.337638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.338371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:15:00.338713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:00.341178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:00.353163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1003/1986] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:15:00.358237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172f834-a717-4edb-a5a9-9d4ab31d1c51 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:00.367504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172f834-a717-4edb-a5a9-9d4ab31d1c51 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:00.372972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:00.373639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.373922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.374200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.374952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:00.376874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:00.475235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 984/1987] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:00 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:00.475606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:00.484427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8421d-800e-4932-85e0-120308c38a98 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:00.543705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:00.544659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.544971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.545247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.545983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:00.547992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:00.700349 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1004/1988] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:00 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:15:00.704467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:00.715775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef0afc-fc19-4026-a4c4-05afa8ee2c5f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:00.720415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:00.721085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.721370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.721673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.722407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:00.724048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:00.736888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 985/1989] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:00.739214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:00.750145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c7b2-0483-416a-a34d-5bdd235dc636 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:00.754741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9c404-f989-490e-8df3-9a6dd870ca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:00.756756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9c404-f989-490e-8df3-9a6dd870ca2f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.756756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9c404-f989-490e-8df3-9a6dd870ca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.756756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9c404-f989-490e-8df3-9a6dd870ca2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.757057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9c404-f989-490e-8df3-9a6dd870ca2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:00.758506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9c404-f989-490e-8df3-9a6dd870ca2f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:00.773534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1005/1990] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:00.774717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:00.786135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4936c6-c927-4d1e-a3a9-9d8b2e1394d1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:00.791051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:00.794029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.794029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.794029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] PATH_INFO: `/v3/projects/b822e17d08cf49f79e8fd7faaa92a0a3/users/0be7ea3f86e04222ba3de78ec21b2b0b/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.808752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b822e17d08cf49f79e8fd7faaa92a0a3, user_id=0be7ea3f86e04222ba3de78ec21b2b0b, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:00.813177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:00.915341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 986/1991] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:00 2022] PUT /identity/v3/projects/b822e17d08cf49f79e8fd7faaa92a0a3/users/0be7ea3f86e04222ba3de78ec21b2b0b/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:00.917161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0973faa-d085-40d4-86bf-e2e06aa3f4ca None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:00.917453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0973faa-d085-40d4-86bf-e2e06aa3f4ca None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:00.917732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0973faa-d085-40d4-86bf-e2e06aa3f4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:00.944818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c0973faa-d085-40d4-86bf-e2e06aa3f4ca None None] MFA Rules not processed for user `0be7ea3f86e04222ba3de78ec21b2b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:00.946071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c0973faa-d085-40d4-86bf-e2e06aa3f4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:01.010309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1006/1992] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:01.022370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:01.024022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:01.083781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877889-ad1f-4d0f-9d08-104773cb7ed6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:01.087472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:01.088151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:01.088436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:01.088712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:01.098834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:01.101303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:01.109741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 987/1993] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:04.023868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0148bb-7f13-41fe-a4ca-fbdd21795b4d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:04.031745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0148bb-7f13-41fe-a4ca-fbdd21795b4d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:04.031745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0148bb-7f13-41fe-a4ca-fbdd21795b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:04.047404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-be0148bb-7f13-41fe-a4ca-fbdd21795b4d None None] MFA Rules not processed for user `0be7ea3f86e04222ba3de78ec21b2b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:04.048609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-be0148bb-7f13-41fe-a4ca-fbdd21795b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:04.056389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1007/1994] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:10.756560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:10.757971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:10.821973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15f937-c5dd-4ef1-b5b1-b79ced364976 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:10.826517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:10.834839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:10.834839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:10.834839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] PATH_INFO: `/v3/users/201ecf38ebda4bc985a46fd54ec6ac80` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:10.834839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201ecf38ebda4bc985a46fd54ec6ac80)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:10.834839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:11.038720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201ecf38ebda4bc985a46fd54ec6ac80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:11.109189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201ecf38ebda4bc985a46fd54ec6ac80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:11.121592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201ecf38ebda4bc985a46fd54ec6ac80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:11.122279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201ecf38ebda4bc985a46fd54ec6ac80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:11.122950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201ecf38ebda4bc985a46fd54ec6ac80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:11.135710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 988/1995] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:10 2022] DELETE /identity/v3/users/201ecf38ebda4bc985a46fd54ec6ac80 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:11.140279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:11.140775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:11.140874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:11.159589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:11.160809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:11.225596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1008/1996] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:11.238325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:11.239698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:11.325368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b0ed-63e2-47c8-817b-c29fab9049d8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:11.329763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:11.330556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:11.331145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:11.331529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:11.344011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:11.345383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:11.366399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 989/1997] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:11.787507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:11.787507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:11.798342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4199-554f-4019-b9f2-4d671a781aa9 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:11.804553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:11.810384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:11.810384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:11.810384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] PATH_INFO: `/v3/projects/c759ce11077644b6a806d5c605b2cfcb` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:11.810384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c759ce11077644b6a806d5c605b2cfcb)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:11.810384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:11.949452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c759ce11077644b6a806d5c605b2cfcb', 'request_id': 'req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:11.954682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c759ce11077644b6a806d5c605b2cfcb', 'request_id': 'req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.060856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c759ce11077644b6a806d5c605b2cfcb', 'request_id': 'req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.073567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] The token cache is being invalidate because project c759ce11077644b6a806d5c605b2cfcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:12.073835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.074503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.076076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1009/1998] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:11 2022] DELETE /identity/v3/projects/c759ce11077644b6a806d5c605b2cfcb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:12.079985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:12.090159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d3a36-d2bf-49c3-a31a-78891ef24150 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:12.144673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:12.145554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:12.145833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:12.146103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] PATH_INFO: `/v3/users/af544ff3f9bb4657994a8043f78648a9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:12.147315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=af544ff3f9bb4657994a8043f78648a9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:12.149247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:12.436830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af544ff3f9bb4657994a8043f78648a9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.529126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af544ff3f9bb4657994a8043f78648a9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.544009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af544ff3f9bb4657994a8043f78648a9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.544767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af544ff3f9bb4657994a8043f78648a9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.545392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-6f95c90d-7825-43d2-82ed-44ff43e706fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af544ff3f9bb4657994a8043f78648a9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:12.558323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 990/1999] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:12 2022] DELETE /identity/v3/users/af544ff3f9bb4657994a8043f78648a9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:12.994662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:12.996729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:13.011052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99626c-7b03-4f65-9e26-d7ac9daa5ccb admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:13.073796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:13.074731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:13.075036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:13.075326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] PATH_INFO: `/v3/projects/ab63e6156c6d42a7968cee78a22934e6` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:13.076644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab63e6156c6d42a7968cee78a22934e6)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:13.078572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:13.331532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab63e6156c6d42a7968cee78a22934e6', 'request_id': 'req-f6636977-5eb7-48a6-88db-4d0013a320f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:13.336870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab63e6156c6d42a7968cee78a22934e6', 'request_id': 'req-f6636977-5eb7-48a6-88db-4d0013a320f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:13.468605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab63e6156c6d42a7968cee78a22934e6', 'request_id': 'req-f6636977-5eb7-48a6-88db-4d0013a320f3'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:13.482684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] The token cache is being invalidate because project ab63e6156c6d42a7968cee78a22934e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:13.482987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:13.489475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f6636977-5eb7-48a6-88db-4d0013a320f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:13.489475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1010/2000] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:12 2022] DELETE /identity/v3/projects/ab63e6156c6d42a7968cee78a22934e6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:13.490462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986ff7-6009-4b24-a146-591ff17fa7dc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:13.490939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986ff7-6009-4b24-a146-591ff17fa7dc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:13.491123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986ff7-6009-4b24-a146-591ff17fa7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:13.510110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-77986ff7-6009-4b24-a146-591ff17fa7dc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:13.511309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-77986ff7-6009-4b24-a146-591ff17fa7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:13.570447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 991/2001] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:13.578668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7c89-2557-4669-b171-eb00a1c3623d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:13.578958 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7c89-2557-4669-b171-eb00a1c3623d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:13.579236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7c89-2557-4669-b171-eb00a1c3623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:13.598094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-87af7c89-2557-4669-b171-eb00a1c3623d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:13.599248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-87af7c89-2557-4669-b171-eb00a1c3623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:13.607423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1011/2002] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:13.611625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77986ff7-6009-4b24-a146-591ff17fa7dc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:13.621910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77986ff7-6009-4b24-a146-591ff17fa7dc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:13.626557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:13.627241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:13.627523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:13.627798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:13.628516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:15:13.628822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:13.630410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:13.642564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 992/2003] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:15:13.646796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7c89-2557-4669-b171-eb00a1c3623d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:13.656013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7c89-2557-4669-b171-eb00a1c3623d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:13.660965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:13.661622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:13.661904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:13.662182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:13.662908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:13.665011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:13.818499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1012/2004] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:13 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:13.823871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:13.840053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251933-57d1-466e-8830-bd093c5bf204 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:13.900254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:13.900906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:13.901418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:13.901655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:13.902383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:13.904428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.012457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 993/2005] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:13 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:14.023579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.034831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262f90b-af7d-420a-abd6-3cdc83687a5a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.040865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.041550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.041837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.042116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.042891 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.049584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.059954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1013/2006] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:14.063438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.073723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348b5d-e59c-4b0f-9669-c7f2ce9b2822 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.078478 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae488c-6824-432d-b60c-0547182e67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.079192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae488c-6824-432d-b60c-0547182e67c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.079474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae488c-6824-432d-b60c-0547182e67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.079753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae488c-6824-432d-b60c-0547182e67c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.080474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae488c-6824-432d-b60c-0547182e67c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.082064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae488c-6824-432d-b60c-0547182e67c7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.092394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 994/2007] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:14.096743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.107504 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71ed8f-9252-4b7d-a67b-f3e74d764a45 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.112062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.112940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.113222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.113496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] PATH_INFO: `/v3/projects/5b89cf4fe7664a159aa5f8854b6fc10b/users/cb9cf6bdfb754c9c821284c6c4627d50/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.128548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b89cf4fe7664a159aa5f8854b6fc10b, user_id=cb9cf6bdfb754c9c821284c6c4627d50, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.131249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.218231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1014/2008] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:14 2022] PUT /identity/v3/projects/5b89cf4fe7664a159aa5f8854b6fc10b/users/cb9cf6bdfb754c9c821284c6c4627d50/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:14.230777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e509d07-fea1-40e9-8172-896729104ec4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.231073 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e509d07-fea1-40e9-8172-896729104ec4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.231362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e509d07-fea1-40e9-8172-896729104ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.263717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1e509d07-fea1-40e9-8172-896729104ec4 None None] MFA Rules not processed for user `cb9cf6bdfb754c9c821284c6c4627d50`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:14.265126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1e509d07-fea1-40e9-8172-896729104ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:14.329579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 995/2009] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:14.334161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.393439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d454242-e0a3-4b52-8421-7c21816517f2 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.398052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.399344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.399542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.399821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.400511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.402403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.506686 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1015/2010] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:14 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:14.510649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e509d07-fea1-40e9-8172-896729104ec4 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.521287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e509d07-fea1-40e9-8172-896729104ec4 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.575415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.576085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.576372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.576641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.577329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.579251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.706597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 996/2011] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:14 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:14.710678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.721766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bf95a-25ec-4d41-9260-b30dde967dee admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.726462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.727776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.728057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.728332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.729071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.730775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.741684 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1016/2012] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:14.745884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.756234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341c1c-2612-4414-b371-e4f511e0a71e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.762563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.763721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.764071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.764419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] PATH_INFO: `/v3/projects/fb73a832109a45b6a42252a2b0cc47e5/users/5d852bf0b05e4ea4bedaf2be60e224f6/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.780409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb73a832109a45b6a42252a2b0cc47e5, user_id=5d852bf0b05e4ea4bedaf2be60e224f6, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.783430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.877179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 997/2013] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:14 2022] PUT /identity/v3/projects/fb73a832109a45b6a42252a2b0cc47e5/users/5d852bf0b05e4ea4bedaf2be60e224f6/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:14.881155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.890936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f3e99-1b32-483f-8223-31f747e7a8fe admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.951552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f39bd8-e414-4f4e-9b4f-81c80a44469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.952223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f39bd8-e414-4f4e-9b4f-81c80a44469d admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.952502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f39bd8-e414-4f4e-9b4f-81c80a44469d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.952775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f39bd8-e414-4f4e-9b4f-81c80a44469d admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.953498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f39bd8-e414-4f4e-9b4f-81c80a44469d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:14.955118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f39bd8-e414-4f4e-9b4f-81c80a44469d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:14.968452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1017/2014] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:14.970070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:14.981354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ade454-d2a9-403e-ab01-9929c59265e2 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:14.995514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:14.996655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:14.996940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:14.997217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] PATH_INFO: `/v3/projects/fb73a832109a45b6a42252a2b0cc47e5/users/5d852bf0b05e4ea4bedaf2be60e224f6/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:14.999304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb73a832109a45b6a42252a2b0cc47e5, user_id=5d852bf0b05e4ea4bedaf2be60e224f6, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:15.002143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:15.014281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 998/2015] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:14 2022] PUT /identity/v3/projects/fb73a832109a45b6a42252a2b0cc47e5/users/5d852bf0b05e4ea4bedaf2be60e224f6/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:15.024460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9493b59-a7e8-47e2-aae9-746ffb3c18f0 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:15.025100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9493b59-a7e8-47e2-aae9-746ffb3c18f0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:15.025100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9493b59-a7e8-47e2-aae9-746ffb3c18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:15.052506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f9493b59-a7e8-47e2-aae9-746ffb3c18f0 None None] MFA Rules not processed for user `5d852bf0b05e4ea4bedaf2be60e224f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:15.053698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f9493b59-a7e8-47e2-aae9-746ffb3c18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:15.123011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1018/2016] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:15.134547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:15.136306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:15.191722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f39ea-b661-4010-8a86-445b94e6f1c4 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:15.195459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:15.196647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:15.196949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:15.197213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:15.261892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:15.263620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:15.273736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 999/2017] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:30.140619 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9493b59-a7e8-47e2-aae9-746ffb3c18f0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:30.151198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9493b59-a7e8-47e2-aae9-746ffb3c18f0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:30.155635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:30.156493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:30.156815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:30.157100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:30.168047 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:30.169532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:30.181196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1019/2018] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:39.034420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:39.036857 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:39.038283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:39.041163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:39.260464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d00fe-e451-41f8-94fb-67cdaf2da515 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:39.263180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8a126-1b28-42e9-825d-138d61a5564f service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:39.267156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:39.268914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:39.270038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:39.270538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] PATH_INFO: `/v3/users/ed1dacde91404110b259cfab7a37bb80` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:39.271110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:39.272145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:39.272485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:39.272830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] PATH_INFO: `/v3/users/92e9b195f18d47819308a1132b7fa936` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:39.272928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1dacde91404110b259cfab7a37bb80)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:39.274429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e9b195f18d47819308a1132b7fa936)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:39.276312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:39.276723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:39.568017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e9b195f18d47819308a1132b7fa936'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.568683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e9b195f18d47819308a1132b7fa936'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.575743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e9b195f18d47819308a1132b7fa936'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.637079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1dacde91404110b259cfab7a37bb80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.657248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e9b195f18d47819308a1132b7fa936'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.658118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce937e1e-0ddc-4967-ba16-23a828f8b8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e9b195f18d47819308a1132b7fa936'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.683606 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1020/2019] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:39 2022] DELETE /identity/v3/users/92e9b195f18d47819308a1132b7fa936 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:39.692675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:39.693155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:39.693579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:39.721470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:39.722913 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:39.744298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1dacde91404110b259cfab7a37bb80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.758266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1dacde91404110b259cfab7a37bb80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.759009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1dacde91404110b259cfab7a37bb80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.760168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1dacde91404110b259cfab7a37bb80'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:39.773162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1000/2020] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:39 2022] DELETE /identity/v3/users/ed1dacde91404110b259cfab7a37bb80 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:39.789750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1021/2021] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:39.811345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:39.812849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:39.938461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48558712-4ab5-4d94-ab0c-69f059b76782 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:39.945455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc08fdd-3306-41b2-a342-d29c2a88f6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:39.946128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc08fdd-3306-41b2-a342-d29c2a88f6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:39.946413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc08fdd-3306-41b2-a342-d29c2a88f6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:39.946741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc08fdd-3306-41b2-a342-d29c2a88f6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.025313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc08fdd-3306-41b2-a342-d29c2a88f6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:40.026836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc08fdd-3306-41b2-a342-d29c2a88f6b3 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:40.039153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1001/2022] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:40.077698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:40.079223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:40.108351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69406b-4c90-412c-9b10-86dd88509086 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:40.108351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:40.108351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.108351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.109059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] PATH_INFO: `/v3/projects/23366fa77e9049af8c183f6959cc158f` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.109059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23366fa77e9049af8c183f6959cc158f)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:40.109059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:40.241631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23366fa77e9049af8c183f6959cc158f', 'request_id': 'req-45bf9d06-0e75-4133-ab56-eacc223a30b9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.247052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23366fa77e9049af8c183f6959cc158f', 'request_id': 'req-45bf9d06-0e75-4133-ab56-eacc223a30b9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.349921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23366fa77e9049af8c183f6959cc158f', 'request_id': 'req-45bf9d06-0e75-4133-ab56-eacc223a30b9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.362823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] The token cache is being invalidate because project 23366fa77e9049af8c183f6959cc158f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:40.362823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.364476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-45bf9d06-0e75-4133-ab56-eacc223a30b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.377746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1022/2023] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:40 2022] DELETE /identity/v3/projects/23366fa77e9049af8c183f6959cc158f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:40.389647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9e25-51c6-43b1-982a-5dd42b13baf2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.389945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9e25-51c6-43b1-982a-5dd42b13baf2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.390223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9e25-51c6-43b1-982a-5dd42b13baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.429352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4f6c9e25-51c6-43b1-982a-5dd42b13baf2 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:40.430553 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4f6c9e25-51c6-43b1-982a-5dd42b13baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:40.493225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1002/2024] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:40.500944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797751b-f2b8-4916-862b-6f1b392058fe None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.501225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797751b-f2b8-4916-862b-6f1b392058fe None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.501498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797751b-f2b8-4916-862b-6f1b392058fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.519789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-5797751b-f2b8-4916-862b-6f1b392058fe None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:40.520968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5797751b-f2b8-4916-862b-6f1b392058fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:40.529103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1023/2025] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:40.533350 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c9e25-51c6-43b1-982a-5dd42b13baf2 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:40.543847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c9e25-51c6-43b1-982a-5dd42b13baf2 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:40.549048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:40.549861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.550137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.550442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.551768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:15:40.552095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:40.553682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:40.566492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1003/2026] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:15:40.571197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797751b-f2b8-4916-862b-6f1b392058fe None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:40.580872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797751b-f2b8-4916-862b-6f1b392058fe None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:40.586096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:40.586802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.587090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.587367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.588077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:40.590019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:40.611420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:40.614195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:40.628902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dafae-636f-42e5-8224-7df2d9b5369b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:40.634575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:40.635703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.636233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.636898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] PATH_INFO: `/v3/projects/854e7bd7838b48eeaca75aaf2311dd21` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.638586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=854e7bd7838b48eeaca75aaf2311dd21)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:40.641451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:40.694564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1024/2027] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:40 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:40.708269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:40.777030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854e7bd7838b48eeaca75aaf2311dd21', 'request_id': 'req-9a418517-6773-4355-8b36-954482ccfe1d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.777256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da595c02-8a8a-4eba-8749-43d16abfd119 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:40.835525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:40.836198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.836513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.836786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.837477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:40.839432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:40.887855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854e7bd7838b48eeaca75aaf2311dd21', 'request_id': 'req-9a418517-6773-4355-8b36-954482ccfe1d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.887855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854e7bd7838b48eeaca75aaf2311dd21', 'request_id': 'req-9a418517-6773-4355-8b36-954482ccfe1d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.901390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] The token cache is being invalidate because project 854e7bd7838b48eeaca75aaf2311dd21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:40.902100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.902735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9a418517-6773-4355-8b36-954482ccfe1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:40.905166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1004/2028] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:40 2022] DELETE /identity/v3/projects/854e7bd7838b48eeaca75aaf2311dd21 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:40.910425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80aeea-3887-465e-99a5-e2f13540b9ad None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.910859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80aeea-3887-465e-99a5-e2f13540b9ad None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.911326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80aeea-3887-465e-99a5-e2f13540b9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.965906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0d80aeea-3887-465e-99a5-e2f13540b9ad None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:40.965906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d80aeea-3887-465e-99a5-e2f13540b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:40.965906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1005/2029] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:40.973735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77944b2-c6e0-4451-a09b-34206547ea50 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:40.973989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77944b2-c6e0-4451-a09b-34206547ea50 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:40.974265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77944b2-c6e0-4451-a09b-34206547ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:40.993670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d77944b2-c6e0-4451-a09b-34206547ea50 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:40.994952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d77944b2-c6e0-4451-a09b-34206547ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:41.003848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1006/2030] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:41.008274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77944b2-c6e0-4451-a09b-34206547ea50 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.017558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77944b2-c6e0-4451-a09b-34206547ea50 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.023356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.024038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.024324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.024603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.025335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:15:41.025734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.027372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.039716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1007/2031] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:15:41.043997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.056755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b35a5-03dc-4588-bf16-03af3d8a559c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.061647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.062335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.062587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.062906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.063753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.065728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.087384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1025/2032] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:40 2022] POST /identity/v3/users => generated 294 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:15:41.093356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.093356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:41.101787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b51a7-fd33-4cf2-b61e-59e75fa0e678 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.106332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.107020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.107300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.107572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.108295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.109875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.123079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1026/2033] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:15:41.127093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.138009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f4dcc-d289-4665-aa4d-7aec649700ab admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.142852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.145073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.145073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.145073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.145633 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.147265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.158658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1027/2034] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:15:41.162502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.172745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07bd9b-be23-4a37-97b4-37defa1bdb89 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.177516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6847d-1920-4e03-8880-bcb78ce18fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.179725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6847d-1920-4e03-8880-bcb78ce18fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.179725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6847d-1920-4e03-8880-bcb78ce18fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.179725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6847d-1920-4e03-8880-bcb78ce18fc5 admin admin] PATH_INFO: `/v3/projects/d44e7af0cad24b2c85c0fa389f043ebf/users/829a578c563a4f509782ce60238e5943/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.197544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6847d-1920-4e03-8880-bcb78ce18fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44e7af0cad24b2c85c0fa389f043ebf, user_id=829a578c563a4f509782ce60238e5943, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.202308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6847d-1920-4e03-8880-bcb78ce18fc5 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.209377 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1008/2035] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:41 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:15:41.214132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.297055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1028/2036] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:41 2022] PUT /identity/v3/projects/d44e7af0cad24b2c85c0fa389f043ebf/users/829a578c563a4f509782ce60238e5943/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:41.299481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55374abb-9718-4401-b07c-5872c0084284 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.308356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e0d4-34e2-4d93-98ef-1421c4d54ba7 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.308635 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e0d4-34e2-4d93-98ef-1421c4d54ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.309103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e0d4-34e2-4d93-98ef-1421c4d54ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.350022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-77c0e0d4-34e2-4d93-98ef-1421c4d54ba7 None None] MFA Rules not processed for user `829a578c563a4f509782ce60238e5943`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:41.351210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-77c0e0d4-34e2-4d93-98ef-1421c4d54ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:41.365167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.365167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.365441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.365590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.366397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.368352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.442254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1029/2037] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:41.446675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0e0d4-34e2-4d93-98ef-1421c4d54ba7 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.456844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0e0d4-34e2-4d93-98ef-1421c4d54ba7 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.464879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1009/2038] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:41 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:15:41.465023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.465023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.465023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.465023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.465376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.465464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.465904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.476430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0dfb-781d-462f-bbed-56d1348eebf0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.481084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.481751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.482038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.482317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.483097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.488303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.495495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1010/2039] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:15:41.499692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.509907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9b7c-2f9b-4269-8845-5b95fb66c5d2 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.514758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.515639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.515919 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.516227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.517004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.518585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.528977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1011/2040] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:15:41.532993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.542697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4e13-49c6-4b6d-9f66-dc314cf54c7b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.554634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aebe86-dd24-48d3-b741-0458dbe7ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.554634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aebe86-dd24-48d3-b741-0458dbe7ec26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.554634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aebe86-dd24-48d3-b741-0458dbe7ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.554634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aebe86-dd24-48d3-b741-0458dbe7ec26 admin admin] PATH_INFO: `/v3/projects/b2d7dee7188943ae84823848038e5357/users/37dd6eaa597d4b61b3c7f3719217baa1/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.571375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1030/2041] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:41 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:15:41.571569 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aebe86-dd24-48d3-b741-0458dbe7ec26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7dee7188943ae84823848038e5357, user_id=37dd6eaa597d4b61b3c7f3719217baa1, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.573932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aebe86-dd24-48d3-b741-0458dbe7ec26 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.575397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.637985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45240c-3898-45c0-b082-e89c309bfe84 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.642661 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.643326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.643605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.644497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.645195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.647099 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.675936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1012/2042] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:41 2022] PUT /identity/v3/projects/b2d7dee7188943ae84823848038e5357/users/37dd6eaa597d4b61b3c7f3719217baa1/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:41.680770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.681060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.681337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.697582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:41.698846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:41.757445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1013/2043] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:41.766843 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.768167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:41.780504 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1031/2044] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:41 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:41.785823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.796033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae39fc1-d9c9-4592-b21c-6a8a1eb279b8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.800953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.801609 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.801894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.802177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.802935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.804523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.817162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1032/2045] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:15:41.826407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d57a2-93eb-4c80-af0c-659245b932ab None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.826538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:41.830090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.830781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.831066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.831959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.837619 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bf3da-62aa-4161-8b20-3522ada8782b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:41.842283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:41.843212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:41.843502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:41.843755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] PATH_INFO: `/v3/projects/8a65216d864448898d0b6906484f255a/users/ef3738a5c9ba47dcad4166d58ddff279/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:41.844190 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.845626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.856147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1014/2046] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:15:41.861351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a65216d864448898d0b6906484f255a, user_id=ef3738a5c9ba47dcad4166d58ddff279, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:41.864411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:41.989723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1033/2047] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:41 2022] PUT /identity/v3/projects/8a65216d864448898d0b6906484f255a/users/ef3738a5c9ba47dcad4166d58ddff279/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:41.993682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:42.003841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b90c-e285-453e-a583-cb0c984f7e67 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:42.066552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd3368-358a-4052-992c-2ebb676e4568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:42.067532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3368-358a-4052-992c-2ebb676e4568 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:42.067761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3368-358a-4052-992c-2ebb676e4568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:42.068064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3368-358a-4052-992c-2ebb676e4568 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:42.068798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd3368-358a-4052-992c-2ebb676e4568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:42.070402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd3368-358a-4052-992c-2ebb676e4568 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:42.081086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1015/2048] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:42.085832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:42.096171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be0fb-c11c-4396-9ec7-1c09646f4304 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:42.101328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:42.102234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:42.102527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:42.103031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] PATH_INFO: `/v3/projects/8a65216d864448898d0b6906484f255a/users/ef3738a5c9ba47dcad4166d58ddff279/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:42.105004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a65216d864448898d0b6906484f255a, user_id=ef3738a5c9ba47dcad4166d58ddff279, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:42.107752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:42.118831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1034/2049] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:42 2022] PUT /identity/v3/projects/8a65216d864448898d0b6906484f255a/users/ef3738a5c9ba47dcad4166d58ddff279/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:42.129502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56c9a-8f31-490c-8cf7-404126c58d4c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:42.129701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56c9a-8f31-490c-8cf7-404126c58d4c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:42.129986 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56c9a-8f31-490c-8cf7-404126c58d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:42.156649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c1d56c9a-8f31-490c-8cf7-404126c58d4c None None] MFA Rules not processed for user `ef3738a5c9ba47dcad4166d58ddff279`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:42.158065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c1d56c9a-8f31-490c-8cf7-404126c58d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:42.226399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1016/2050] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:42.245399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:42.245636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:42.315171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1838ca-59f2-4c2d-9b27-027eb5907aad admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:42.319798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2b23-6a3f-4922-9bc4-0108782e8c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:42.320453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2b23-6a3f-4922-9bc4-0108782e8c48 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:42.320731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2b23-6a3f-4922-9bc4-0108782e8c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:42.321006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2b23-6a3f-4922-9bc4-0108782e8c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:42.331770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2b23-6a3f-4922-9bc4-0108782e8c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:42.333541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2b23-6a3f-4922-9bc4-0108782e8c48 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:42.343743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1035/2051] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:42.411511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56c9a-8f31-490c-8cf7-404126c58d4c None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:42.473893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56c9a-8f31-490c-8cf7-404126c58d4c None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:42.479059 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:42.480427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:42.480427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:42.480645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] PATH_INFO: `/v3/users/829a578c563a4f509782ce60238e5943` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:42.481824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=829a578c563a4f509782ce60238e5943)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:42.483740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:42.707870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829a578c563a4f509782ce60238e5943'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:42.757739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829a578c563a4f509782ce60238e5943'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:42.772136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829a578c563a4f509782ce60238e5943'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:42.773011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829a578c563a4f509782ce60238e5943'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:42.773635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829a578c563a4f509782ce60238e5943'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:42.787594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1017/2052] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:42 2022] DELETE /identity/v3/users/829a578c563a4f509782ce60238e5943 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:42.793608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab20e-8c60-42c5-adcc-9a045bb48dbb None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:42.793972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab20e-8c60-42c5-adcc-9a045bb48dbb None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:42.794317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab20e-8c60-42c5-adcc-9a045bb48dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:42.814547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-80eab20e-8c60-42c5-adcc-9a045bb48dbb None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:42.814547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-80eab20e-8c60-42c5-adcc-9a045bb48dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:42.874833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1036/2053] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:42.884862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:42.886382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:42.944378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff53fc-8aeb-446a-9386-8c8130bc0abc admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:42.948160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:42.948808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:42.949092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:42.949371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:42.958883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:42.960307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:42.974111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1018/2054] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:43.445352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:43.445900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:43.445900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:43.465921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:43.471269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:43.477533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] MFA Rules not processed for user `37dd6eaa597d4b61b3c7f3719217baa1`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:43.479241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:43.489080 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d5c8-d374-4251-af4b-7f3379a8a419 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:43.494029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:43.495057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:43.495403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:43.495901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] PATH_INFO: `/v3/projects/d44e7af0cad24b2c85c0fa389f043ebf` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:43.497327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44e7af0cad24b2c85c0fa389f043ebf)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:43.499530 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:43.560332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1037/2055] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:43.577376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:43.578731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:43.601829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44e7af0cad24b2c85c0fa389f043ebf', 'request_id': 'req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:43.634151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ed90c-3b4b-4a2e-b997-7afef9e6c38e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:43.680477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44e7af0cad24b2c85c0fa389f043ebf', 'request_id': 'req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:43.682818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:43.682818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:43.683048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:43.683298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:43.688010 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44e7af0cad24b2c85c0fa389f043ebf', 'request_id': 'req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:43.700479 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] The token cache is being invalidate because project d44e7af0cad24b2c85c0fa389f043ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:43.700802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:43.701448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:43.705493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1019/2056] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:43 2022] DELETE /identity/v3/projects/d44e7af0cad24b2c85c0fa389f043ebf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:43.706957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:43.708290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:43.748098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:43.750219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:43.762764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1038/2057] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:15:43.778785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577e79b-d24c-4c6f-88c0-bd9ba5bdd061 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:43.786745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:43.787763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:43.788148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:43.788527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] PATH_INFO: `/v3/users/ef3738a5c9ba47dcad4166d58ddff279` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:43.790078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3738a5c9ba47dcad4166d58ddff279)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:43.792401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:44.021506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3738a5c9ba47dcad4166d58ddff279'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.120742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3738a5c9ba47dcad4166d58ddff279'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.134878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3738a5c9ba47dcad4166d58ddff279'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.135569 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3738a5c9ba47dcad4166d58ddff279'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.136222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d28d06fc-4052-4ae1-9888-dd06f433d713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3738a5c9ba47dcad4166d58ddff279'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.148548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1020/2058] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:43 2022] DELETE /identity/v3/users/ef3738a5c9ba47dcad4166d58ddff279 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:44.571220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:44.583666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7095b-b78e-410f-b9f2-bac6b90758d7 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:44.638821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:44.640215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:44.640547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:44.640830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] PATH_INFO: `/v3/projects/8a65216d864448898d0b6906484f255a` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:44.642105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a65216d864448898d0b6906484f255a)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:44.644582 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:44.757118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a65216d864448898d0b6906484f255a', 'request_id': 'req-1f2a4636-bedb-498d-aa38-7383ca09f9b5'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.762437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a65216d864448898d0b6906484f255a', 'request_id': 'req-1f2a4636-bedb-498d-aa38-7383ca09f9b5'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.840592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a65216d864448898d0b6906484f255a', 'request_id': 'req-1f2a4636-bedb-498d-aa38-7383ca09f9b5'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.855408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] The token cache is being invalidate because project 8a65216d864448898d0b6906484f255a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:44.855853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.856829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-1f2a4636-bedb-498d-aa38-7383ca09f9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:44.858712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1039/2059] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:44 2022] DELETE /identity/v3/projects/8a65216d864448898d0b6906484f255a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:44.864075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7218fa-2e63-4c6a-b431-fe378cca2922 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:44.866481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7218fa-2e63-4c6a-b431-fe378cca2922 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:44.866481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7218fa-2e63-4c6a-b431-fe378cca2922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:44.883302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7b7218fa-2e63-4c6a-b431-fe378cca2922 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:44.884634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7b7218fa-2e63-4c6a-b431-fe378cca2922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:44.952924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1021/2060] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:44.960990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b063ee-76bc-478d-88e5-3b4fb381c416 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:44.961405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b063ee-76bc-478d-88e5-3b4fb381c416 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:44.961674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b063ee-76bc-478d-88e5-3b4fb381c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:44.982350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-71b063ee-76bc-478d-88e5-3b4fb381c416 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:44.983646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-71b063ee-76bc-478d-88e5-3b4fb381c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:44.995683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1040/2061] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:44.996932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7218fa-2e63-4c6a-b431-fe378cca2922 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.008235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7218fa-2e63-4c6a-b431-fe378cca2922 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.015065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.017783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.017783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.017783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.017783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:15:45.017783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.019953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:45.032526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1022/2062] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:15:45.037335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b063ee-76bc-478d-88e5-3b4fb381c416 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.046421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b063ee-76bc-478d-88e5-3b4fb381c416 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.051953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.052659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.052923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.053189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.053890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.055819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:45.147350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1041/2063] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:45 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:45.151409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.162652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f7c11-a8a3-4a6b-ab05-3b64d0f09d97 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.225364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.226142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.226433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.226781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.227519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.229470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:45.347467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1023/2064] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:45 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:45.355004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.361232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb3b9b-6b6b-42e8-b32c-989606c45ddd admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.365814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.366478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.366789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.367062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.367788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.369362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:45.382837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1042/2065] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:45.383605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.394247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7b3cb-382e-4387-ac60-da6249f2609a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.399355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684468e8-5dfb-4e37-9e39-9bbdca75104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.400056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684468e8-5dfb-4e37-9e39-9bbdca75104a admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.400404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684468e8-5dfb-4e37-9e39-9bbdca75104a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.400863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684468e8-5dfb-4e37-9e39-9bbdca75104a admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.401852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684468e8-5dfb-4e37-9e39-9bbdca75104a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.403862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684468e8-5dfb-4e37-9e39-9bbdca75104a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:45.414436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1024/2066] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:45.418584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.428788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82e8ca-81c6-454f-9c54-320cce59f019 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.433241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.434106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.434382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.434674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] PATH_INFO: `/v3/projects/7dcadac7d65647cba3931f31d91bfb38/users/f055ceaf15af4cc8916da57d50d0283e/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.449143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dcadac7d65647cba3931f31d91bfb38, user_id=f055ceaf15af4cc8916da57d50d0283e, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.451842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:45.603140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1043/2067] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:45 2022] PUT /identity/v3/projects/7dcadac7d65647cba3931f31d91bfb38/users/f055ceaf15af4cc8916da57d50d0283e/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:45.614699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b35b-2a2f-46d2-8607-c8613323ee54 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.614992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b35b-2a2f-46d2-8607-c8613323ee54 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.615274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b35b-2a2f-46d2-8607-c8613323ee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.641552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1bd6b35b-2a2f-46d2-8607-c8613323ee54 None None] MFA Rules not processed for user `f055ceaf15af4cc8916da57d50d0283e`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:45.642788 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1bd6b35b-2a2f-46d2-8607-c8613323ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:45.706371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1025/2068] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:45.710798 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.771046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b0a1-f213-4a51-8ada-e7e6756f081f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.775657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.776357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.776639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.776916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.777610 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.779799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:45.890448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1044/2069] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:45 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:45.896285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b35b-2a2f-46d2-8607-c8613323ee54 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:45.907667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b35b-2a2f-46d2-8607-c8613323ee54 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:45.963567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:45.964176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:45.964467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:45.964742 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:45.965435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:45.967430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:46.061459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1026/2070] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:45 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:15:46.065931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:46.080889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f942b-5a7f-450d-8355-5367a3fb1f8a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:46.089760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:46.090439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:46.090764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:46.091039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:46.091768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:46.093490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:46.104470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1045/2071] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:46.108766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:46.119824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488afbd-7230-4be1-ac70-729cfb2ba33a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:46.124610 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:46.125489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:46.125763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:46.126035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] PATH_INFO: `/v3/projects/e14afd1109a64fd7acaae9941c3b9f8c/users/a8b05dec02d64f4eb60eb8600cd8edba/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:46.140901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14afd1109a64fd7acaae9941c3b9f8c, user_id=a8b05dec02d64f4eb60eb8600cd8edba, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:46.144262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:46.241431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1027/2072] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:46 2022] PUT /identity/v3/projects/e14afd1109a64fd7acaae9941c3b9f8c/users/a8b05dec02d64f4eb60eb8600cd8edba/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:46.245331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:46.256084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e013-b096-4a02-937f-d5941f396267 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:46.312643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edd5a6-4192-462a-87cd-9dacc1924e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:46.313292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edd5a6-4192-462a-87cd-9dacc1924e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:46.313597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edd5a6-4192-462a-87cd-9dacc1924e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:46.313878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edd5a6-4192-462a-87cd-9dacc1924e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:46.314619 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edd5a6-4192-462a-87cd-9dacc1924e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:46.316930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edd5a6-4192-462a-87cd-9dacc1924e0d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:46.326332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1046/2073] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:46.330539 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:46.341360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b876be-c1be-42a4-bae1-219bf800a6bb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:46.346282 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:46.347202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:46.347485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:46.347761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] PATH_INFO: `/v3/projects/e14afd1109a64fd7acaae9941c3b9f8c/users/a8b05dec02d64f4eb60eb8600cd8edba/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:46.349791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14afd1109a64fd7acaae9941c3b9f8c, user_id=a8b05dec02d64f4eb60eb8600cd8edba, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:46.352690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:46.363382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1028/2074] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:46 2022] PUT /identity/v3/projects/e14afd1109a64fd7acaae9941c3b9f8c/users/a8b05dec02d64f4eb60eb8600cd8edba/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:46.373481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04c26-d0bf-4f5e-bb6d-75212c71c0df None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:46.373773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04c26-d0bf-4f5e-bb6d-75212c71c0df None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:46.374053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04c26-d0bf-4f5e-bb6d-75212c71c0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:46.402283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-6fb04c26-d0bf-4f5e-bb6d-75212c71c0df None None] MFA Rules not processed for user `a8b05dec02d64f4eb60eb8600cd8edba`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:46.403900 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6fb04c26-d0bf-4f5e-bb6d-75212c71c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:46.473216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1047/2075] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:46.484861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:46.486533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:46.545154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155903d3-da21-4491-bf69-5fae41d61905 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:46.548810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e62ed-9ed8-4907-b17c-10a6980b3704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:46.550159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e62ed-9ed8-4907-b17c-10a6980b3704 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:46.550513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e62ed-9ed8-4907-b17c-10a6980b3704 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:46.550849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e62ed-9ed8-4907-b17c-10a6980b3704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:46.559955 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e62ed-9ed8-4907-b17c-10a6980b3704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:46.561375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e62ed-9ed8-4907-b17c-10a6980b3704 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:46.571144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1029/2076] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:46.621787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04c26-d0bf-4f5e-bb6d-75212c71c0df None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:46.631583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04c26-d0bf-4f5e-bb6d-75212c71c0df None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:46.637736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ffebe-f9e0-47cf-8238-bb8e5c7aaa77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:46.637736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffebe-f9e0-47cf-8238-bb8e5c7aaa77 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:46.637736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffebe-f9e0-47cf-8238-bb8e5c7aaa77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:46.637736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffebe-f9e0-47cf-8238-bb8e5c7aaa77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:46.693922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ffebe-f9e0-47cf-8238-bb8e5c7aaa77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:46.695621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ffebe-f9e0-47cf-8238-bb8e5c7aaa77 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:46.704772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1048/2077] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:48.701563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4fa93-dadd-4d98-b978-5fd87d4d06e6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:48.702138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4fa93-dadd-4d98-b978-5fd87d4d06e6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:48.702138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4fa93-dadd-4d98-b978-5fd87d4d06e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:48.719339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0be4fa93-dadd-4d98-b978-5fd87d4d06e6 None None] MFA Rules not processed for user `37dd6eaa597d4b61b3c7f3719217baa1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:48.720524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0be4fa93-dadd-4d98-b978-5fd87d4d06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:48.772750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1030/2078] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:49.042187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51247-782a-4e56-bd88-b07baa6c0e0f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:49.042719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51247-782a-4e56-bd88-b07baa6c0e0f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:49.042829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51247-782a-4e56-bd88-b07baa6c0e0f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:49.044537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1049/2079] 10.222.0.58 () {54 vars in 912 bytes} [Thu Mar 31 18:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:15:49.050582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5d65-1464-4b0b-998e-552dafd2b711 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:49.050905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5d65-1464-4b0b-998e-552dafd2b711 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:49.051224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5d65-1464-4b0b-998e-552dafd2b711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:49.071780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e19f5d65-1464-4b0b-998e-552dafd2b711 None None] MFA Rules not processed for user `7436a3068f6545a4b74c877c5b8c81c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:49.072976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e19f5d65-1464-4b0b-998e-552dafd2b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:49.121128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1031/2080] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:15:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:49.135050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51247-782a-4e56-bd88-b07baa6c0e0f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:49.136730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1ae51247-782a-4e56-bd88-b07baa6c0e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:49.149864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51247-782a-4e56-bd88-b07baa6c0e0f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:49.153730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:49.154449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:49.154861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:49.155124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:49.162508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:49.163979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:49.172308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1050/2081] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:15:54.303133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959a08-6990-4713-9db1-90f83a279d23 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:54.303592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959a08-6990-4713-9db1-90f83a279d23 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:54.303670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959a08-6990-4713-9db1-90f83a279d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:54.336151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5e959a08-6990-4713-9db1-90f83a279d23 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:54.337588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5e959a08-6990-4713-9db1-90f83a279d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:54.394201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1032/2082] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:15:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:54.436839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:54.438211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:54.508837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4306f-bf41-44d8-ace8-b3c91e6a8585 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:54.513926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:54.514638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:54.514956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:54.515141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:54.524482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:54.526068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:54.534568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1051/2083] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:15:55.507106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:55.507560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:55.507669 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:55.525630 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:55.527142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:55.535156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1033/2084] 10.222.0.58 () {58 vars in 967 bytes} [Thu Mar 31 18:15:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:55.548045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:55.558298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd67ca8-c18c-41c9-942b-94ef868bdc22 service swift] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:55.564767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5cba0-5841-4153-b19c-3a52bf1dfd87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:55.565531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5cba0-5841-4153-b19c-3a52bf1dfd87 service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:55.565817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5cba0-5841-4153-b19c-3a52bf1dfd87 service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:55.566099 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5cba0-5841-4153-b19c-3a52bf1dfd87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:55.574667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5cba0-5841-4153-b19c-3a52bf1dfd87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:55.576240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5cba0-5841-4153-b19c-3a52bf1dfd87 service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:55.585217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1052/2085] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:15:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:15:55.752814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:55.754282 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:55.821410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf021e5-e61d-4348-a34c-d7d4b0d72a07 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:55.825992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:55.826917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:55.827203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:55.827476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] PATH_INFO: `/v3/users/ddfa8498157b4fe198e83da05ed780b4` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:55.828712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddfa8498157b4fe198e83da05ed780b4)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:55.830937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:56.063264 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddfa8498157b4fe198e83da05ed780b4'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.127575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddfa8498157b4fe198e83da05ed780b4'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.141359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddfa8498157b4fe198e83da05ed780b4'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.142132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddfa8498157b4fe198e83da05ed780b4'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.142868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddfa8498157b4fe198e83da05ed780b4'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.155838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1034/2086] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:55 2022] DELETE /identity/v3/users/ddfa8498157b4fe198e83da05ed780b4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:56.277549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:56.278006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:56.278399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:56.304187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:56.305697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:56.375987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1053/2087] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:15:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:56.389248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:56.390848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:56.452368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:56.453830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:56.482996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79426e22-2e2b-4c06-8adb-43aa9477c001 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:56.490153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:56.490990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:56.491345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:56.491692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:56.501615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:56.503617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:56.514728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1035/2088] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:15:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 31 18:15:56.540559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482fd97-f034-44e0-b2c1-39867fe5dd19 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:56.545348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:56.546658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:56.546943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:56.547223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] PATH_INFO: `/v3/projects/92cbf027ed994b2da86041820afa7b35` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:56.549676 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=92cbf027ed994b2da86041820afa7b35)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:56.551640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:56.714427 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cbf027ed994b2da86041820afa7b35', 'request_id': 'req-963aa55f-276d-409d-bc5e-2827d0ce12ce'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.721016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cbf027ed994b2da86041820afa7b35', 'request_id': 'req-963aa55f-276d-409d-bc5e-2827d0ce12ce'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.812980 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cbf027ed994b2da86041820afa7b35', 'request_id': 'req-963aa55f-276d-409d-bc5e-2827d0ce12ce'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.826391 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] The token cache is being invalidate because project 92cbf027ed994b2da86041820afa7b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:56.826708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.827383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-963aa55f-276d-409d-bc5e-2827d0ce12ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:56.829003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1054/2089] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:56 2022] DELETE /identity/v3/projects/92cbf027ed994b2da86041820afa7b35 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:56.833269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:56.846040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1754d-f2c5-4b9a-aa74-4669297c4c0d service swift] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:56.905235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:56.906228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:56.906513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:56.906816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] PATH_INFO: `/v3/users/5e46c73c3c44435e86bf75055bea0cb8` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:56.908717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e46c73c3c44435e86bf75055bea0cb8)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:56.910650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:57.129743 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e46c73c3c44435e86bf75055bea0cb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.175643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:57.175931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:57.176210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:57.194180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:57.195410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:57.241304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e46c73c3c44435e86bf75055bea0cb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.249595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1055/2090] 10.222.0.58 () {58 vars in 967 bytes} [Thu Mar 31 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:57.254436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e46c73c3c44435e86bf75055bea0cb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.255160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e46c73c3c44435e86bf75055bea0cb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.255764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e46c73c3c44435e86bf75055bea0cb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.261696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:57.263177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:57.269004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1036/2091] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:15:56 2022] DELETE /identity/v3/users/5e46c73c3c44435e86bf75055bea0cb8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:15:57.338959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bd7e0-e703-4030-a549-dda9501931f4 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:57.420816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f368b9-f155-404e-a569-11bed1e79064 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:57.421464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f368b9-f155-404e-a569-11bed1e79064 service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:57.421778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f368b9-f155-404e-a569-11bed1e79064 service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:57.422053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f368b9-f155-404e-a569-11bed1e79064 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:57.424156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-36f368b9-f155-404e-a569-11bed1e79064 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:57.482420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f368b9-f155-404e-a569-11bed1e79064 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:57.483964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f368b9-f155-404e-a569-11bed1e79064 service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:57.492270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1056/2092] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:15:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 31 18:15:57.555929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:57.556810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:57.622699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3964ab-78b2-4c13-a7ad-9996c5854e5d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:57.627918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:57.631782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:57.631782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:57.631782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] PATH_INFO: `/v3/projects/5d1721b4b84c4f86b3c28efdba42d6e7` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:57.631782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1721b4b84c4f86b3c28efdba42d6e7)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:57.632701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:57.762182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1721b4b84c4f86b3c28efdba42d6e7', 'request_id': 'req-8b0c03ff-1646-44e4-8eb6-cc8d87651584'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.830471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1721b4b84c4f86b3c28efdba42d6e7', 'request_id': 'req-8b0c03ff-1646-44e4-8eb6-cc8d87651584'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.836464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1721b4b84c4f86b3c28efdba42d6e7', 'request_id': 'req-8b0c03ff-1646-44e4-8eb6-cc8d87651584'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.848095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] The token cache is being invalidate because project 5d1721b4b84c4f86b3c28efdba42d6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:15:57.848408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.849048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8b0c03ff-1646-44e4-8eb6-cc8d87651584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:15:57.850588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1037/2093] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:15:57 2022] DELETE /identity/v3/projects/5d1721b4b84c4f86b3c28efdba42d6e7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:57.856160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f20202-686e-4b05-aa77-ff5a127ac8c6 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:57.856668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f20202-686e-4b05-aa77-ff5a127ac8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:57.856789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f20202-686e-4b05-aa77-ff5a127ac8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:57.887588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-51f20202-686e-4b05-aa77-ff5a127ac8c6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:57.888709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-51f20202-686e-4b05-aa77-ff5a127ac8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:57.963457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1057/2094] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:57.971394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43cd9-a635-4ac3-a0d3-c165d6eee72b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:57.971686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43cd9-a635-4ac3-a0d3-c165d6eee72b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:57.971966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43cd9-a635-4ac3-a0d3-c165d6eee72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:57.995303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d8c43cd9-a635-4ac3-a0d3-c165d6eee72b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:57.996680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d8c43cd9-a635-4ac3-a0d3-c165d6eee72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:58.021776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f20202-686e-4b05-aa77-ff5a127ac8c6 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.021901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1038/2095] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:58.027673 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f20202-686e-4b05-aa77-ff5a127ac8c6 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:58.033740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:58.034462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.034920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.035362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.036242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:15:58.036708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:58.038524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:58.051777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1058/2096] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:15:58.062845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43cd9-a635-4ac3-a0d3-c165d6eee72b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.077607 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43cd9-a635-4ac3-a0d3-c165d6eee72b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:58.085632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:58.086329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.086567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.086877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.088238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:58.090173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:58.217178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1039/2097] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:58 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:58.225758 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.236458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62db16f-d8e7-43ff-a3e1-6dceda2c422c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:58.295424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:58.296488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.296488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.296666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.298185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:58.300732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:58.410666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1059/2098] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:58 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:58.414947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.432309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0659cb3-6b39-4d22-b8ef-d3fdbedb7ee9 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:58.444603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:58.445353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.446710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.447051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.447874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:58.455002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:58.467251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1040/2099] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:58.474220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.484424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f902e-a01b-4fb9-818e-d46e8f9bf088 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:58.490198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b48df-a74b-4f75-bbaa-889a14560367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:58.491066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b48df-a74b-4f75-bbaa-889a14560367 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.491434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b48df-a74b-4f75-bbaa-889a14560367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.491771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b48df-a74b-4f75-bbaa-889a14560367 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.492569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b48df-a74b-4f75-bbaa-889a14560367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:58.494238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b48df-a74b-4f75-bbaa-889a14560367 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:58.506252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1060/2100] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:58.510462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.520503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2c347-df7a-4b7a-b777-aa405e3ef667 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:58.525074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:58.525976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.526234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.526792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] PATH_INFO: `/v3/projects/4b7ac844cb2b4f8c894deefd7301366e/users/1a278544e33c4542bf83bbc7a1684f97/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.542187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7ac844cb2b4f8c894deefd7301366e, user_id=1a278544e33c4542bf83bbc7a1684f97, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:58.544863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:58.628140 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1041/2101] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:58 2022] PUT /identity/v3/projects/4b7ac844cb2b4f8c894deefd7301366e/users/1a278544e33c4542bf83bbc7a1684f97/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:58.639399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c25b-a9ca-4209-a305-039881b6bf7d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.639772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c25b-a9ca-4209-a305-039881b6bf7d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.640100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c25b-a9ca-4209-a305-039881b6bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.666646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d9f3c25b-a9ca-4209-a305-039881b6bf7d None None] MFA Rules not processed for user `1a278544e33c4542bf83bbc7a1684f97`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:58.667775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d9f3c25b-a9ca-4209-a305-039881b6bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:58.731262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1061/2102] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:15:58.736211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.807847 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8772ee9-c2ac-4fc5-8fb1-a646ef6e829d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:58.816617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:58.817671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:58.817671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:58.817878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:58.818540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:58.820556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:58.950927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1042/2103] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:15:58 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:58.956763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c25b-a9ca-4209-a305-039881b6bf7d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:58.969887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c25b-a9ca-4209-a305-039881b6bf7d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:59.033316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:59.034256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:59.034660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:59.034993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:59.036423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:59.053240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:59.186342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1062/2104] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:15:58 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:15:59.192691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:59.203220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981940b6-8a27-4ee4-8523-f78790a065c7 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:59.208482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:59.209151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:59.209457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:59.209905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:59.210660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:59.212387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:59.222981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1043/2105] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:59.227205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:59.239076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f674f-9391-4dad-8410-0815fad094f8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:59.243941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:59.245114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:59.245399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:59.245671 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] PATH_INFO: `/v3/projects/0ea96f12b8e349aeb84ce54ef557dd26/users/2f64afcbe71842108b57eeec44b4dc67/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:59.261725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea96f12b8e349aeb84ce54ef557dd26, user_id=2f64afcbe71842108b57eeec44b4dc67, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:59.265615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:59.407336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1063/2106] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:59 2022] PUT /identity/v3/projects/0ea96f12b8e349aeb84ce54ef557dd26/users/2f64afcbe71842108b57eeec44b4dc67/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:59.411182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:59.420823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97fadf-1bb1-4edf-9058-4fb38c9c2849 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:59.481626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431bbbc-b774-4e9e-8833-7f85a173917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:59.482313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431bbbc-b774-4e9e-8833-7f85a173917d admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:59.482594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431bbbc-b774-4e9e-8833-7f85a173917d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:59.482966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431bbbc-b774-4e9e-8833-7f85a173917d admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:59.483622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431bbbc-b774-4e9e-8833-7f85a173917d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:59.485745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431bbbc-b774-4e9e-8833-7f85a173917d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:59.496093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1044/2107] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:15:59.501230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:59.511853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb41ae-222a-4fa1-a390-9dfcc1398fe0 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:59.517018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:59.518020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:59.518367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:59.519022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] PATH_INFO: `/v3/projects/0ea96f12b8e349aeb84ce54ef557dd26/users/2f64afcbe71842108b57eeec44b4dc67/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:59.521233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea96f12b8e349aeb84ce54ef557dd26, user_id=2f64afcbe71842108b57eeec44b4dc67, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:59.524150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:59.535256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1064/2108] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:15:59 2022] PUT /identity/v3/projects/0ea96f12b8e349aeb84ce54ef557dd26/users/2f64afcbe71842108b57eeec44b4dc67/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:15:59.551477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898755-9024-462a-ae25-812591052cbe None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:59.551817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898755-9024-462a-ae25-812591052cbe None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:59.552097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898755-9024-462a-ae25-812591052cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:59.579668 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-07898755-9024-462a-ae25-812591052cbe None None] MFA Rules not processed for user `2f64afcbe71842108b57eeec44b4dc67`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:15:59.580878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-07898755-9024-462a-ae25-812591052cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:59.661979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1045/2109] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:15:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:15:59.673717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:15:59.675524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:15:59.736155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c5d4-bae0-4622-9f89-184b213f1070 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:15:59.740029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17796d95-77d4-4f4b-adbb-441b04350933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:15:59.740803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796d95-77d4-4f4b-adbb-441b04350933 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:15:59.741115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796d95-77d4-4f4b-adbb-441b04350933 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:15:59.741400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796d95-77d4-4f4b-adbb-441b04350933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:15:59.807462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17796d95-77d4-4f4b-adbb-441b04350933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:15:59.808906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17796d95-77d4-4f4b-adbb-441b04350933 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:15:59.818948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1065/2110] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:15:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:16:00.524379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898755-9024-462a-ae25-812591052cbe None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:00.526464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-07898755-9024-462a-ae25-812591052cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:00.627007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898755-9024-462a-ae25-812591052cbe None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:00.636261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:00.640422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:00.640422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:00.640422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] PATH_INFO: `/v3/users/0be7ea3f86e04222ba3de78ec21b2b0b` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:00.640422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be7ea3f86e04222ba3de78ec21b2b0b)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:00.642566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:00.890645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be7ea3f86e04222ba3de78ec21b2b0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:00.983413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be7ea3f86e04222ba3de78ec21b2b0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:00.996595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be7ea3f86e04222ba3de78ec21b2b0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:00.997311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be7ea3f86e04222ba3de78ec21b2b0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:00.997918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be7ea3f86e04222ba3de78ec21b2b0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:01.009736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1046/2111] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:00 2022] DELETE /identity/v3/users/0be7ea3f86e04222ba3de78ec21b2b0b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:01.014659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:01.017673 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:01.017673 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:01.033637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:01.035081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:01.096206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1066/2112] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:01.105904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:01.107504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:01.170481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ccc0-9d54-4f40-a17b-2d4677da0088 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:01.175011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f524e-9dd3-409b-a960-ffe419217bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:01.175667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f524e-9dd3-409b-a960-ffe419217bab service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:01.175948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f524e-9dd3-409b-a960-ffe419217bab service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:01.176323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f524e-9dd3-409b-a960-ffe419217bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:01.186195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f524e-9dd3-409b-a960-ffe419217bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:01.188375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f524e-9dd3-409b-a960-ffe419217bab service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:01.198580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1047/2113] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:01.537599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:01.539076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:01.551509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0536-dcc8-4d1f-9762-a992ef88f221 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:01.556552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:01.556991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:01.557274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:01.557550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] PATH_INFO: `/v3/projects/b822e17d08cf49f79e8fd7faaa92a0a3` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:01.558800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b822e17d08cf49f79e8fd7faaa92a0a3)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:01.560723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:01.715346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'request_id': 'req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:01.721345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'request_id': 'req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:01.849127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'request_id': 'req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:01.860783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] The token cache is being invalidate because project b822e17d08cf49f79e8fd7faaa92a0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:01.861008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:01.861653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46aef210-e0e3-4c1a-bb72-2793f2fc66f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:01.863213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1067/2114] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:01 2022] DELETE /identity/v3/projects/b822e17d08cf49f79e8fd7faaa92a0a3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:01.868209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5df9d2-cd44-4e27-9972-d3608befd89d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:01.869483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5df9d2-cd44-4e27-9972-d3608befd89d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:01.869483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5df9d2-cd44-4e27-9972-d3608befd89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:01.887146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-9b5df9d2-cd44-4e27-9972-d3608befd89d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:01.888330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9b5df9d2-cd44-4e27-9972-d3608befd89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:01.949498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1048/2115] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:01.958372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737244dd-8704-43e9-b102-0066f29a1458 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:01.958681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737244dd-8704-43e9-b102-0066f29a1458 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:01.958961 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737244dd-8704-43e9-b102-0066f29a1458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:01.977951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-737244dd-8704-43e9-b102-0066f29a1458 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:01.979197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-737244dd-8704-43e9-b102-0066f29a1458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:01.987933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1068/2116] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:01.992481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5df9d2-cd44-4e27-9972-d3608befd89d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:02.002752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5df9d2-cd44-4e27-9972-d3608befd89d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:02.007704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:02.008373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.008775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.008956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.010036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:02.010036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:02.011612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:02.026652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1049/2117] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:16:02.030068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737244dd-8704-43e9-b102-0066f29a1458 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:02.040507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737244dd-8704-43e9-b102-0066f29a1458 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:02.045490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:02.047742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.053175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.053175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.053175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:02.053175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:02.188899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1069/2118] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:02 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:02.198251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:02.209309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488768f3-5b92-4bd7-8f1f-18eb183021cf admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:02.270043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:02.270741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.271023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.271294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.271998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:02.273922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:02.398824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1050/2119] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:02 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:02.403058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:02.468556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429efe-620d-4bc4-ba17-e8495a93e6bc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:02.473263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:02.473917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.474194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.474465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.475245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:02.476853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:02.487644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1070/2120] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:16:02.491595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:02.502423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ddcd-14a2-4d34-b5d2-920b14fa86e3 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:02.507012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689f4b0-d702-4cd1-9f19-8977f5f41035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:02.507662 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f4b0-d702-4cd1-9f19-8977f5f41035 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.508024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f4b0-d702-4cd1-9f19-8977f5f41035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.508304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f4b0-d702-4cd1-9f19-8977f5f41035 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.509025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689f4b0-d702-4cd1-9f19-8977f5f41035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:02.510599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689f4b0-d702-4cd1-9f19-8977f5f41035 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:02.523924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1051/2121] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:02.525041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:02.535508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b951-a6f5-4a6c-b609-e8906dc2360f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:02.539998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:02.540871 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.541154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.541428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] PATH_INFO: `/v3/projects/7db0ac9e7cca4a75b882e7189bf2e374/users/b4957ed9ec9f4c368b89c75789fdda27/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.556215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db0ac9e7cca4a75b882e7189bf2e374, user_id=b4957ed9ec9f4c368b89c75789fdda27, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:02.558863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:02.641040 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1071/2122] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:02 2022] PUT /identity/v3/projects/7db0ac9e7cca4a75b882e7189bf2e374/users/b4957ed9ec9f4c368b89c75789fdda27/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:02.651408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.651622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.651896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.684863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] MFA Rules not processed for user `b4957ed9ec9f4c368b89c75789fdda27`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:02.686075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:02.748891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1052/2123] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:02.759915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:02.761733 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:02.827079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10537e-1044-4527-a16c-b50f9f78e756 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:02.831007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddd5d5-8870-4c0e-b240-bbcd9d1a1062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:02.831655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddd5d5-8870-4c0e-b240-bbcd9d1a1062 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:02.831932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddd5d5-8870-4c0e-b240-bbcd9d1a1062 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:02.832204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddd5d5-8870-4c0e-b240-bbcd9d1a1062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:02.846834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddd5d5-8870-4c0e-b240-bbcd9d1a1062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:02.848270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddd5d5-8870-4c0e-b240-bbcd9d1a1062 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:02.860543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1072/2124] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:09.440710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:09.442277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:09.506266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c616-681a-4101-85f0-f0e0ebc7e134 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:09.511192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:09.512136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:09.512432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:09.512707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] PATH_INFO: `/v3/users/0576f1c15a0544fc85642ac7d857d95b` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:09.513915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0576f1c15a0544fc85642ac7d857d95b)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:09.515994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:09.805238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0576f1c15a0544fc85642ac7d857d95b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:09.893877 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0576f1c15a0544fc85642ac7d857d95b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:09.908379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0576f1c15a0544fc85642ac7d857d95b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:09.909556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0576f1c15a0544fc85642ac7d857d95b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:09.920137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0576f1c15a0544fc85642ac7d857d95b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:09.925329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1053/2125] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:09 2022] DELETE /identity/v3/users/0576f1c15a0544fc85642ac7d857d95b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:09.929652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:09.934506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:09.934506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:09.949045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:09.950317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:10.020679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1073/2126] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:10.031385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:10.033773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:10.103257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78ac9-119b-4ca6-b634-1f8e376b92a1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:10.107594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:10.108359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:10.108839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:10.109057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:10.118465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:10.123635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:10.131527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1054/2127] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:10.520041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:10.520041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:10.535512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1ed6-0e58-4322-bbe5-6301c7c67cd0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:10.540956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:10.541841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:10.542119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:10.542393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] PATH_INFO: `/v3/users/f055ceaf15af4cc8916da57d50d0283e` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:10.543647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f055ceaf15af4cc8916da57d50d0283e)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:10.549068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:10.755393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:10.758053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:10.774721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b93b2-1657-48c7-917a-5b48a5a10e75 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:10.781417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:10.782980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:10.783416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:10.783761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] PATH_INFO: `/v3/projects/e74defb771bf498b9375b398c32e7eec` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:10.785905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74defb771bf498b9375b398c32e7eec)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:10.788501 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:10.830630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f055ceaf15af4cc8916da57d50d0283e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:10.831326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f055ceaf15af4cc8916da57d50d0283e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:10.838116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f055ceaf15af4cc8916da57d50d0283e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:10.934998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74defb771bf498b9375b398c32e7eec', 'request_id': 'req-65cc657f-7ab5-43f9-87b6-8faab3b7f615'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:10.951369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f055ceaf15af4cc8916da57d50d0283e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:10.952960 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4e5a955e-ea90-410b-9a26-8da11a0c18bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f055ceaf15af4cc8916da57d50d0283e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:10.971935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1074/2128] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:10 2022] DELETE /identity/v3/users/f055ceaf15af4cc8916da57d50d0283e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:10.976244 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:10.976596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:10.976985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:10.995302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:10.996567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:11.065205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1075/2129] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:11.074754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:11.076127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:11.116812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74defb771bf498b9375b398c32e7eec', 'request_id': 'req-65cc657f-7ab5-43f9-87b6-8faab3b7f615'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.128821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74defb771bf498b9375b398c32e7eec', 'request_id': 'req-65cc657f-7ab5-43f9-87b6-8faab3b7f615'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.138994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2821ad0-a745-45d7-91d4-111d65b74146 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:11.140799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] The token cache is being invalidate because project e74defb771bf498b9375b398c32e7eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:11.141086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.142273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.143602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1055/2130] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:10 2022] DELETE /identity/v3/projects/e74defb771bf498b9375b398c32e7eec => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:11.143848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:11.144575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:11.144858 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:11.145144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:11.147160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:11.147440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:11.148929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:11.160720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:11.162189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:11.173271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1076/2131] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:16:11.232359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc657f-7ab5-43f9-87b6-8faab3b7f615 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:11.240888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:11.243608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:11.244118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:11.244600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] PATH_INFO: `/v3/users/80a054513e4f4b4488feca59d875055a` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:11.251004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a054513e4f4b4488feca59d875055a)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:11.253075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:11.528913 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a054513e4f4b4488feca59d875055a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.608854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a054513e4f4b4488feca59d875055a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.622723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a054513e4f4b4488feca59d875055a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.623446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a054513e4f4b4488feca59d875055a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.624671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a054513e4f4b4488feca59d875055a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:11.637093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1056/2132] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:11 2022] DELETE /identity/v3/users/80a054513e4f4b4488feca59d875055a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:11.737564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:11.739133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:11.751917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f8bb6-27b6-49e9-9dfb-fbd5b28359b8 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:11.815177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:11.816078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:11.816217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:11.816544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] PATH_INFO: `/v3/projects/7dcadac7d65647cba3931f31d91bfb38` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:11.817817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dcadac7d65647cba3931f31d91bfb38)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:11.820175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:12.221205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dcadac7d65647cba3931f31d91bfb38', 'request_id': 'req-a09ac7e5-37ea-4af9-b33c-96f5193858f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.226641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dcadac7d65647cba3931f31d91bfb38', 'request_id': 'req-a09ac7e5-37ea-4af9-b33c-96f5193858f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.250187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:12.251589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:12.267183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f734f-e35a-4a91-b643-2bb10dbc9a00 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:12.311043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dcadac7d65647cba3931f31d91bfb38', 'request_id': 'req-a09ac7e5-37ea-4af9-b33c-96f5193858f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.323541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] The token cache is being invalidate because project 7dcadac7d65647cba3931f31d91bfb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:12.323541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.323852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.325432 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1077/2133] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:11 2022] DELETE /identity/v3/projects/7dcadac7d65647cba3931f31d91bfb38 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:12.329767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:12.331298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:12.332790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:12.333708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:12.334019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:12.334294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] PATH_INFO: `/v3/projects/fc6896261e184cf095d84875f151a75c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:12.335567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6896261e184cf095d84875f151a75c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:12.337494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:12.344501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ac7e5-37ea-4af9-b33c-96f5193858f0 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:12.349343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:12.350251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:12.350639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:12.350917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] PATH_INFO: `/v3/users/a8b05dec02d64f4eb60eb8600cd8edba` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:12.352118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b05dec02d64f4eb60eb8600cd8edba)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:12.354016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:12.485212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6896261e184cf095d84875f151a75c', 'request_id': 'req-58d8b54b-5dd1-480f-9d04-29739ff7807a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.575865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6896261e184cf095d84875f151a75c', 'request_id': 'req-58d8b54b-5dd1-480f-9d04-29739ff7807a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.582552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6896261e184cf095d84875f151a75c', 'request_id': 'req-58d8b54b-5dd1-480f-9d04-29739ff7807a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.593939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] The token cache is being invalidate because project fc6896261e184cf095d84875f151a75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:12.594202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.594911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-58d8b54b-5dd1-480f-9d04-29739ff7807a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.596492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1057/2134] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:12 2022] DELETE /identity/v3/projects/fc6896261e184cf095d84875f151a75c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:12.601159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ae9a-66d3-4250-b7e0-de63b07a319c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:12.601449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ae9a-66d3-4250-b7e0-de63b07a319c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:12.601731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ae9a-66d3-4250-b7e0-de63b07a319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:12.619754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c5e8ae9a-66d3-4250-b7e0-de63b07a319c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:12.620952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c5e8ae9a-66d3-4250-b7e0-de63b07a319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:12.625468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b05dec02d64f4eb60eb8600cd8edba'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.626275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b05dec02d64f4eb60eb8600cd8edba'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.634186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b05dec02d64f4eb60eb8600cd8edba'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.683169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1058/2135] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:12.691211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd1bd-c7b2-4530-bd77-6862201ff0ce None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:12.702817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd1bd-c7b2-4530-bd77-6862201ff0ce None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:12.702817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd1bd-c7b2-4530-bd77-6862201ff0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:12.709907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-815cd1bd-c7b2-4530-bd77-6862201ff0ce None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:12.711141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-815cd1bd-c7b2-4530-bd77-6862201ff0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:12.719205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1059/2136] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:12.721877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b05dec02d64f4eb60eb8600cd8edba'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.722831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b05dec02d64f4eb60eb8600cd8edba'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:12.725740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd1bd-c7b2-4530-bd77-6862201ff0ce None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:12.732617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd1bd-c7b2-4530-bd77-6862201ff0ce None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:12.738394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:12.739119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:12.739401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:12.739781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:12.740428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:12.740734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:12.742342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:12.747876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1078/2137] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:12 2022] DELETE /identity/v3/users/a8b05dec02d64f4eb60eb8600cd8edba => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:12.754872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1060/2138] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:16:12.759043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:12.760467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:12.824949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972a280-e71a-4c56-9998-c39ad74023ec admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:12.829844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:12.830517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:12.830832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:12.831110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:12.831805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:12.833707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:12.964100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1079/2139] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:12 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:12.965364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:12.982574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347d579-0bcb-4ebd-98a2-35a34c2791d1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:12.997191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:12.999628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:13.048538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.050007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.050942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.051422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.052804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.055672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.096369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0474bf-37e1-41ac-bde2-12d73b63c80f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.100636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.101293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.101580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.101862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.104008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:13.169697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.171865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.181419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1080/2140] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:16:13.205806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1061/2141] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:12 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:13.209244 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:13.218089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350ce9-dc26-48a7-9ea1-f4e633e12463 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.222590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.223270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.223551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.223825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.224542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.226434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.238511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1081/2142] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:13.242678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:13.254308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b11be-ceb7-439b-a2d6-3750fac273fc admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.259239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.260155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.260603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.260891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.261744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.263757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.278379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1062/2143] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:13.279189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:13.282452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:13.282790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:13.294188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf80e3-1c6a-44ef-8173-6d3f356c80e1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.300865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361ac4-8b92-4072-9e5c-333384fbb65e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.301671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a8c5e-fe6f-4c36-a702-78461955ddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.302538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8c5e-fe6f-4c36-a702-78461955ddb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.303556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8c5e-fe6f-4c36-a702-78461955ddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.304014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8c5e-fe6f-4c36-a702-78461955ddb5 admin admin] PATH_INFO: `/v3/projects/527d27a69f1a4d919930aed5ef2a0bf3/users/7b62804828a84990b67f229c2c3b72fb/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.317620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.319714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.320936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.321625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] PATH_INFO: `/v3/projects/e14afd1109a64fd7acaae9941c3b9f8c` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.323380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14afd1109a64fd7acaae9941c3b9f8c)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.323630 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a8c5e-fe6f-4c36-a702-78461955ddb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527d27a69f1a4d919930aed5ef2a0bf3, user_id=7b62804828a84990b67f229c2c3b72fb, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.325791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.327562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a8c5e-fe6f-4c36-a702-78461955ddb5 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.450521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1063/2144] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:13 2022] PUT /identity/v3/projects/527d27a69f1a4d919930aed5ef2a0bf3/users/7b62804828a84990b67f229c2c3b72fb/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:13.460860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d34b1-b18d-4aba-9484-94cdf664ed37 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.461146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d34b1-b18d-4aba-9484-94cdf664ed37 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.461425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d34b1-b18d-4aba-9484-94cdf664ed37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.487674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0e9d34b1-b18d-4aba-9484-94cdf664ed37 None None] MFA Rules not processed for user `7b62804828a84990b67f229c2c3b72fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:13.488859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0e9d34b1-b18d-4aba-9484-94cdf664ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:13.531646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14afd1109a64fd7acaae9941c3b9f8c', 'request_id': 'req-3bf8fada-219f-49ee-bfdc-847499373290'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:13.537568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14afd1109a64fd7acaae9941c3b9f8c', 'request_id': 'req-3bf8fada-219f-49ee-bfdc-847499373290'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:13.556991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1064/2145] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:13.564172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d34b1-b18d-4aba-9484-94cdf664ed37 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:13.620769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d34b1-b18d-4aba-9484-94cdf664ed37 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.674221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.674908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.675193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.675466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.676149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.678033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.745037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14afd1109a64fd7acaae9941c3b9f8c', 'request_id': 'req-3bf8fada-219f-49ee-bfdc-847499373290'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:13.759344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] The token cache is being invalidate because project e14afd1109a64fd7acaae9941c3b9f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:13.759631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:13.760454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3bf8fada-219f-49ee-bfdc-847499373290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:13.766385 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1082/2146] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:13 2022] DELETE /identity/v3/projects/e14afd1109a64fd7acaae9941c3b9f8c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:13.777176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adb571-528c-48d6-a7db-cd2f1c02408f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.777473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adb571-528c-48d6-a7db-cd2f1c02408f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.777756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adb571-528c-48d6-a7db-cd2f1c02408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.798341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-45adb571-528c-48d6-a7db-cd2f1c02408f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:13.799469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-45adb571-528c-48d6-a7db-cd2f1c02408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:13.807956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1083/2147] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:13.816250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a72ee-a316-4489-97fa-a3f666b38c0d None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.816730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a72ee-a316-4489-97fa-a3f666b38c0d None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.817138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a72ee-a316-4489-97fa-a3f666b38c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.840695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1065/2148] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:13 2022] POST /identity/v3/projects => generated 381 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:13.842949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:13.844992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-908a72ee-a316-4489-97fa-a3f666b38c0d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:13.846238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:13.846370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-908a72ee-a316-4489-97fa-a3f666b38c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:13.952691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1084/2149] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:13.956948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a72ee-a316-4489-97fa-a3f666b38c0d None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:13.968712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fae1a0-54a5-415c-b679-ff01623e2548 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.969506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a72ee-a316-4489-97fa-a3f666b38c0d None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:13.974362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.974873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:13.975071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.975345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.975622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.975902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:13.976247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:13.976368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:13.976528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:13.976622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.977274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:13.978262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.979232 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:13.997078 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1085/2150] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:16:13.998051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.008389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ac83-d64e-4a64-852c-1d70698fe8f1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.013022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.013658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.014508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.014930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.015612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.017475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.100120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1066/2151] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:13 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:14.104423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.114661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5d5d9-36f8-4d7e-b905-ff1fbc41ed5b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.119240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.119880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.120163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.120438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.121246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.122809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.133332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1067/2152] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:16:14.136793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.140127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1086/2153] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:13 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:14.148834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.150316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c7b4e-aa3c-4abf-b085-bd7394558f08 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.209962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.210881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.211163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.211440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] PATH_INFO: `/v3/projects/a4e5bafd6a3e41fa91dd2a78f15b9c2f/users/4f9b4046a5534904a64558f8cad9e7d8/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.218826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eda9fc-301a-43c9-95bc-2c7bd74b916f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.223621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.224286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.224569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.224847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.225591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.226332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e5bafd6a3e41fa91dd2a78f15b9c2f, user_id=4f9b4046a5534904a64558f8cad9e7d8, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.227522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.229022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.359803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1068/2154] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:14 2022] PUT /identity/v3/projects/a4e5bafd6a3e41fa91dd2a78f15b9c2f/users/4f9b4046a5534904a64558f8cad9e7d8/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:14.363532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.422528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1087/2155] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:14 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:14.423999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ef05-7d63-411c-9bee-962db397e4c4 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.426175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.429005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.432722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.437165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea2854-5d6c-44c0-bde2-30bc372dab94 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.441840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.442573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.443048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.443326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.443690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1069/2156] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:16:14.444057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.445645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.447760 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.456655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1088/2157] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:14.458112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c2b0-9ab3-4ab6-b3fb-91bb55558722 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.460409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.469648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.469648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.469648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.469648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] PATH_INFO: `/v3/projects/a4e5bafd6a3e41fa91dd2a78f15b9c2f/users/4f9b4046a5534904a64558f8cad9e7d8/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.470033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e5bafd6a3e41fa91dd2a78f15b9c2f, user_id=4f9b4046a5534904a64558f8cad9e7d8, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.470895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.471032 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd75bc8-8b6b-4d72-be9c-086bb99b2cc3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.475722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19167ec5-f63b-4810-9f19-f454fc014488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.476377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167ec5-f63b-4810-9f19-f454fc014488 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.476665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167ec5-f63b-4810-9f19-f454fc014488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.476997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167ec5-f63b-4810-9f19-f454fc014488 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.477832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167ec5-f63b-4810-9f19-f454fc014488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.479483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167ec5-f63b-4810-9f19-f454fc014488 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.481899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1070/2158] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:14 2022] PUT /identity/v3/projects/a4e5bafd6a3e41fa91dd2a78f15b9c2f/users/4f9b4046a5534904a64558f8cad9e7d8/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:14.494765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1089/2159] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:14.494921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.496691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.498823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.498823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.524016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] MFA Rules not processed for user `4f9b4046a5534904a64558f8cad9e7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:14.532864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:14.557630 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839964-bfeb-40ab-9420-afdd191e37cf admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.563911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1bdea-6194-44dc-b5c7-ffba5d87eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.568807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1bdea-6194-44dc-b5c7-ffba5d87eaed admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.568807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1bdea-6194-44dc-b5c7-ffba5d87eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.568807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1bdea-6194-44dc-b5c7-ffba5d87eaed admin admin] PATH_INFO: `/v3/projects/0389ef682d85435e8321a277daf0218c/users/a5e973ae9ecc46f5b2145d8db14249dc/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.584400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1bdea-6194-44dc-b5c7-ffba5d87eaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0389ef682d85435e8321a277daf0218c, user_id=a5e973ae9ecc46f5b2145d8db14249dc, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.587865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1bdea-6194-44dc-b5c7-ffba5d87eaed admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.593660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1090/2160] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:14.605444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.607068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:14.662051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31eb2-812d-4b0e-a306-ff382c94a8e0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.665777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.666421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.666728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.667004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.676413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.677878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.684732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1071/2161] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:14 2022] PUT /identity/v3/projects/0389ef682d85435e8321a277daf0218c/users/a5e973ae9ecc46f5b2145d8db14249dc/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:14.687952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1091/2162] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:16:14.696212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67017b15-333a-4e11-928d-6f15bb224bbb None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.696212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67017b15-333a-4e11-928d-6f15bb224bbb None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.696212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67017b15-333a-4e11-928d-6f15bb224bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.721260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-67017b15-333a-4e11-928d-6f15bb224bbb None None] MFA Rules not processed for user `a5e973ae9ecc46f5b2145d8db14249dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:14.722462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-67017b15-333a-4e11-928d-6f15bb224bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:14.785268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1072/2163] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:14.797191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:14.798870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:14.864262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806fc8-e60f-4a5c-be71-253fd172c4fb service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:14.918496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bfec7fb739b42bfa2ddd682aa10dc95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:14.919104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:14.919437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:14.919712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:14.929494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:14.931123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:14.942068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1092/2164] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:14.992493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67017b15-333a-4e11-928d-6f15bb224bbb None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:15.080132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67017b15-333a-4e11-928d-6f15bb224bbb None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:15.086589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235a573-4f92-4511-91d3-6f55e5081d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:15.087651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a573-4f92-4511-91d3-6f55e5081d7f service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:15.088154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a573-4f92-4511-91d3-6f55e5081d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:15.088634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a573-4f92-4511-91d3-6f55e5081d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:15.091242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f235a573-4f92-4511-91d3-6f55e5081d7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:15.187889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235a573-4f92-4511-91d3-6f55e5081d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:15.189316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235a573-4f92-4511-91d3-6f55e5081d7f service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:15.224289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1073/2165] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:39.821298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:39.823705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:39.909523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df5067-fcdc-434e-af8f-88e012afe0d1 service glance] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:39.914520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:39.915431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:39.915712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:39.915996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] PATH_INFO: `/v3/users/cb9cf6bdfb754c9c821284c6c4627d50` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:39.917853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9cf6bdfb754c9c821284c6c4627d50)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:39.919895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:40.179681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9cf6bdfb754c9c821284c6c4627d50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:40.180453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9cf6bdfb754c9c821284c6c4627d50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:40.193915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9cf6bdfb754c9c821284c6c4627d50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:40.269440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9cf6bdfb754c9c821284c6c4627d50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:40.270067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9cf6bdfb754c9c821284c6c4627d50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:40.290494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1093/2166] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:39 2022] DELETE /identity/v3/users/cb9cf6bdfb754c9c821284c6c4627d50 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:40.295880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:40.296471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:40.296471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:40.313780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:40.315193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:40.375657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1074/2167] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:40.385595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:40.387103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:40.450282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12553d5-6546-4a7b-9d5e-3c570b592379 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:40.459442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:40.460245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:40.460521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:40.460791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:40.471151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:40.472507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:40.483533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1094/2168] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:40.962443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:40.964026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:40.983106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3403f-863c-4ba5-ade0-30fc8fec14fc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:40.988027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:40.995513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:40.995513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:40.995513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] PATH_INFO: `/v3/projects/5b89cf4fe7664a159aa5f8854b6fc10b` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:40.995513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b89cf4fe7664a159aa5f8854b6fc10b)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:40.996769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:41.132299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b89cf4fe7664a159aa5f8854b6fc10b', 'request_id': 'req-79100fbc-6665-47a6-976c-b3b75c50530c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.280894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b89cf4fe7664a159aa5f8854b6fc10b', 'request_id': 'req-79100fbc-6665-47a6-976c-b3b75c50530c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.294353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b89cf4fe7664a159aa5f8854b6fc10b', 'request_id': 'req-79100fbc-6665-47a6-976c-b3b75c50530c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.309629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] The token cache is being invalidate because project 5b89cf4fe7664a159aa5f8854b6fc10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:41.310197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.310869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.317026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1075/2169] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:40 2022] DELETE /identity/v3/projects/5b89cf4fe7664a159aa5f8854b6fc10b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:41.320960 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:41.331896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05cf00-36eb-4bc8-a8e4-4e59a599a194 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:41.416301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:41.422785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:41.422785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:41.422785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] PATH_INFO: `/v3/users/5d852bf0b05e4ea4bedaf2be60e224f6` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:41.422785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d852bf0b05e4ea4bedaf2be60e224f6)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:41.422785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:41.741459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d852bf0b05e4ea4bedaf2be60e224f6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.742553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d852bf0b05e4ea4bedaf2be60e224f6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.754536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d852bf0b05e4ea4bedaf2be60e224f6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.840495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d852bf0b05e4ea4bedaf2be60e224f6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.841247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d852bf0b05e4ea4bedaf2be60e224f6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:41.871217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1095/2170] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:41 2022] DELETE /identity/v3/users/5d852bf0b05e4ea4bedaf2be60e224f6 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:42.460703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:42.462188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:42.479527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100fbc-6665-47a6-976c-b3b75c50530c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:42.543531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:42.544402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:42.544683 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:42.544975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] PATH_INFO: `/v3/projects/fb73a832109a45b6a42252a2b0cc47e5` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:42.546217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb73a832109a45b6a42252a2b0cc47e5)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:42.548153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:42.706222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:42.707742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:42.726941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e23d-46a5-407d-a328-1716222fe048 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:42.738039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:42.738039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:42.738039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:42.738039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] PATH_INFO: `/v3/users/1a278544e33c4542bf83bbc7a1684f97` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:42.738457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a278544e33c4542bf83bbc7a1684f97)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:42.738457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:42.741996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb73a832109a45b6a42252a2b0cc47e5', 'request_id': 'req-8ce5b236-2717-47bd-9b94-922cf4c9638a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.851707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb73a832109a45b6a42252a2b0cc47e5', 'request_id': 'req-8ce5b236-2717-47bd-9b94-922cf4c9638a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.861598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb73a832109a45b6a42252a2b0cc47e5', 'request_id': 'req-8ce5b236-2717-47bd-9b94-922cf4c9638a'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.871054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] The token cache is being invalidate because project fb73a832109a45b6a42252a2b0cc47e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:42.871342 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.871998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.873556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1076/2171] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:42 2022] DELETE /identity/v3/projects/fb73a832109a45b6a42252a2b0cc47e5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:42.877739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:42.879111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:42.965249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a278544e33c4542bf83bbc7a1684f97'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.965978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a278544e33c4542bf83bbc7a1684f97'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.975202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a278544e33c4542bf83bbc7a1684f97'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:42.976953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5b236-2717-47bd-9b94-922cf4c9638a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:42.984463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb755d3a-3a01-4552-8f3a-ac4d625b285f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:42.985201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755d3a-3a01-4552-8f3a-ac4d625b285f service placement] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:42.985552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755d3a-3a01-4552-8f3a-ac4d625b285f service placement] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:42.985898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755d3a-3a01-4552-8f3a-ac4d625b285f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:42.988446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cb755d3a-3a01-4552-8f3a-ac4d625b285f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.002820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb755d3a-3a01-4552-8f3a-ac4d625b285f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.004687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb755d3a-3a01-4552-8f3a-ac4d625b285f service placement] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.015173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1077/2172] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:43.016441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57078a-844b-4b79-a6db-86249eaca2be None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.016730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57078a-844b-4b79-a6db-86249eaca2be None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.017005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57078a-844b-4b79-a6db-86249eaca2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.034602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-9b57078a-844b-4b79-a6db-86249eaca2be None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:43.035823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9b57078a-844b-4b79-a6db-86249eaca2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.108897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1078/2173] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:43.109119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a278544e33c4542bf83bbc7a1684f97'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:43.109742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d6430780-3f5c-47f4-b11f-3a44c63958fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a278544e33c4542bf83bbc7a1684f97'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:43.116332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0f68-bce3-48ce-b08d-7cfed1078fbc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.119029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0f68-bce3-48ce-b08d-7cfed1078fbc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.119029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0f68-bce3-48ce-b08d-7cfed1078fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.132027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1096/2174] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:42 2022] DELETE /identity/v3/users/1a278544e33c4542bf83bbc7a1684f97 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:43.141747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-8a1a0f68-bce3-48ce-b08d-7cfed1078fbc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:43.143118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8a1a0f68-bce3-48ce-b08d-7cfed1078fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.143434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.144061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.144516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.173170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:43.174513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.215643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1079/2175] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:43.220037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0f68-bce3-48ce-b08d-7cfed1078fbc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.229633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0f68-bce3-48ce-b08d-7cfed1078fbc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:43.235064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:43.235940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.236226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.236578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.237464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:43.237720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.239351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.242737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1097/2176] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:43.251033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.252594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.252809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1080/2177] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:16:43.256978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.266619 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca94885-604b-499d-af1c-127726c582ba admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:43.271291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d8fde-f240-4b63-95e4-6ce4d3bf9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:43.272202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d8fde-f240-4b63-95e4-6ce4d3bf9a49 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.272488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d8fde-f240-4b63-95e4-6ce4d3bf9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.272768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d8fde-f240-4b63-95e4-6ce4d3bf9a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.273464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d8fde-f240-4b63-95e4-6ce4d3bf9a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.275999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d8fde-f240-4b63-95e4-6ce4d3bf9a49 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.326909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e798aa-eb20-478e-ab2e-d6abca7f833b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:43.331703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:43.332425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.332759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.334199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.346430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.348126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.360354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1098/2178] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:43.426279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1081/2179] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:43 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:43.430675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.443626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b911-7d12-4ac7-903e-dd61f24b9827 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:43.504165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:43.505911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.506066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.506511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.507374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.510556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.552166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682bde6-fcde-4bb1-b8ec-b615bad760f2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.552676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682bde6-fcde-4bb1-b8ec-b615bad760f2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.553236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682bde6-fcde-4bb1-b8ec-b615bad760f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.570936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a682bde6-fcde-4bb1-b8ec-b615bad760f2 None None] MFA Rules not processed for user `37dd6eaa597d4b61b3c7f3719217baa1`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:43.572142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a682bde6-fcde-4bb1-b8ec-b615bad760f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.638792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1082/2180] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:43.639455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1099/2181] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:43 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:43.643536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682bde6-fcde-4bb1-b8ec-b615bad760f2 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.655418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682bde6-fcde-4bb1-b8ec-b615bad760f2 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:43.660615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:43.661655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.661999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.662588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.667729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.668834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.680928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1083/2182] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:43.685560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.701213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dff892-ab17-4a29-b1d0-b2b979434182 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:43.707494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decdba1-304c-4446-8a29-4cb9211b8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:43.708844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decdba1-304c-4446-8a29-4cb9211b8d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.709191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decdba1-304c-4446-8a29-4cb9211b8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.710167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decdba1-304c-4446-8a29-4cb9211b8d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.711162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decdba1-304c-4446-8a29-4cb9211b8d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.714111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decdba1-304c-4446-8a29-4cb9211b8d7f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.726755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1100/2183] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:43.731007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.741285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0621-029a-4355-9c2e-e4f638c955e8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:43.747508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:43.748399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.748681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.749115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] PATH_INFO: `/v3/projects/ae970c6423854d0e8dd814cdccbaf7b7/users/b512a50468d6419da03367b633aca61a/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.766517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae970c6423854d0e8dd814cdccbaf7b7, user_id=b512a50468d6419da03367b633aca61a, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:43.769563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:43.838923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1084/2184] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:43 2022] PUT /identity/v3/projects/ae970c6423854d0e8dd814cdccbaf7b7/users/b512a50468d6419da03367b633aca61a/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:43.849428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:43.849709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:43.849982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:43.884512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] MFA Rules not processed for user `b512a50468d6419da03367b633aca61a`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:43.886567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.948144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:43.948144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:43.986136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1101/2185] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:44.006835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:44.011330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:44.056174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0c484-734f-4668-b603-ac054a9b565e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:44.058220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:44.059465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:44.059841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:44.060316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] PATH_INFO: `/v3/projects/4b7ac844cb2b4f8c894deefd7301366e` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:44.061687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7ac844cb2b4f8c894deefd7301366e)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:44.063750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:44.102072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060e7c6-f7bb-438d-88fc-dbb5c3e54b99 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:44.106551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:44.108316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:44.108316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:44.108316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:44.117200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:44.118674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:44.129165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1102/2186] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:16:44.149829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:44.163295 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4d730-e5d3-46da-abf9-5c49b05ea6c1 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:44.168736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:44.169724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:44.170245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:44.170437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] PATH_INFO: `/v3/users/b512a50468d6419da03367b633aca61a` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:44.171749 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b512a50468d6419da03367b633aca61a)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:44.173770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:44.190132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7ac844cb2b4f8c894deefd7301366e', 'request_id': 'req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.289906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7ac844cb2b4f8c894deefd7301366e', 'request_id': 'req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.296064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7ac844cb2b4f8c894deefd7301366e', 'request_id': 'req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.307747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] The token cache is being invalidate because project 4b7ac844cb2b4f8c894deefd7301366e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:44.308048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.308725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.310283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1085/2187] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:43 2022] DELETE /identity/v3/projects/4b7ac844cb2b4f8c894deefd7301366e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:44.314038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:44.315371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:44.378136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4339d2-5fc4-4cf8-aded-22cf616f6f24 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:44.388562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:44.388562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:44.388562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:44.388562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] PATH_INFO: `/v3/users/2f64afcbe71842108b57eeec44b4dc67` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:44.388984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f64afcbe71842108b57eeec44b4dc67)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:44.391471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:44.440492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b512a50468d6419da03367b633aca61a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.441351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b512a50468d6419da03367b633aca61a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.449612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b512a50468d6419da03367b633aca61a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.646281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b512a50468d6419da03367b633aca61a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.647331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b512a50468d6419da03367b633aca61a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.667963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1103/2188] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:44 2022] DELETE /identity/v3/users/b512a50468d6419da03367b633aca61a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:44.669041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:44.670528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:44.741558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e3d1f-6052-4470-abf1-f8b3dd41282d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:44.749187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:44.749187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:44.749438 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:44.749533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] PATH_INFO: `/v3/users/7b62804828a84990b67f229c2c3b72fb` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:44.750873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b62804828a84990b67f229c2c3b72fb)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:44.753140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:44.782240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f64afcbe71842108b57eeec44b4dc67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.857358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f64afcbe71842108b57eeec44b4dc67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.874425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f64afcbe71842108b57eeec44b4dc67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.875209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f64afcbe71842108b57eeec44b4dc67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.875946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a2f8d472-504f-469c-aa79-d7a3c8c9952e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f64afcbe71842108b57eeec44b4dc67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.891963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1086/2189] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:44 2022] DELETE /identity/v3/users/2f64afcbe71842108b57eeec44b4dc67 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:44.894194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:44.894194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:44.894385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:44.922996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:44.925014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:44.965614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b62804828a84990b67f229c2c3b72fb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.966280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b62804828a84990b67f229c2c3b72fb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.973422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b62804828a84990b67f229c2c3b72fb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:44.996882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1087/2190] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:45.006736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:45.008471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.063224 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b62804828a84990b67f229c2c3b72fb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.063883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-77fb969f-d2d3-4e1c-a433-1261bdad1e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b62804828a84990b67f229c2c3b72fb'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.073806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac689c-baaa-455a-9fd5-18d3e63809f1 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:45.079234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb0ca-338c-4cd9-a77b-7081366b1f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:45.079832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb0ca-338c-4cd9-a77b-7081366b1f76 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:45.080261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb0ca-338c-4cd9-a77b-7081366b1f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:45.080805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb0ca-338c-4cd9-a77b-7081366b1f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:45.083037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fa3bb0ca-338c-4cd9-a77b-7081366b1f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.088325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1104/2191] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:44 2022] DELETE /identity/v3/users/7b62804828a84990b67f229c2c3b72fb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:45.090257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:45.090751 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:45.091220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:45.096915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb0ca-338c-4cd9-a77b-7081366b1f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:45.098477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb0ca-338c-4cd9-a77b-7081366b1f76 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:45.109525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1088/2192] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:45.110502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] MFA Rules not processed for user `d6a93e87d6894cfd9b7948274f1d7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:45.110916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:45.118220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:45.118220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:45.118453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.129525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:45.130764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.195787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1105/2193] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:45.257975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1089/2194] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:45.269047 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:45.271024 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.337496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828935a9-cc82-44a6-b1d2-aba84be627a1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:45.341604 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:45.342256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:45.342532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:45.342831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:45.352498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:45.354546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:45.365946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1106/2195] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:45.466162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:45.468644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.495666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682dc95-b6c4-4bd8-bad6-0ecbf254a2f5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:45.520319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:45.521208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:45.521749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:45.522219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] PATH_INFO: `/v3/projects/0ea96f12b8e349aeb84ce54ef557dd26` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:45.523735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea96f12b8e349aeb84ce54ef557dd26)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:45.526632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:45.705796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:45.707724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.723231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea96f12b8e349aeb84ce54ef557dd26', 'request_id': 'req-d149578c-df75-4f36-9441-0c707e02e1ef'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.724691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a516b8-b14d-46b3-9a78-14e798bcf9cf service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:45.799404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:45.800320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:45.800637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:45.800962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] PATH_INFO: `/v3/projects/ae970c6423854d0e8dd814cdccbaf7b7` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:45.804357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae970c6423854d0e8dd814cdccbaf7b7)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:45.806825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:45.855090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea96f12b8e349aeb84ce54ef557dd26', 'request_id': 'req-d149578c-df75-4f36-9441-0c707e02e1ef'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.876304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea96f12b8e349aeb84ce54ef557dd26', 'request_id': 'req-d149578c-df75-4f36-9441-0c707e02e1ef'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.890252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] The token cache is being invalidate because project 0ea96f12b8e349aeb84ce54ef557dd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:45.890801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.894495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d149578c-df75-4f36-9441-0c707e02e1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.897862 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1090/2196] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:45 2022] DELETE /identity/v3/projects/0ea96f12b8e349aeb84ce54ef557dd26 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:45.899379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfad91-0eec-4938-984f-1f81ed71fba3 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:45.899670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfad91-0eec-4938-984f-1f81ed71fba3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:45.900000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfad91-0eec-4938-984f-1f81ed71fba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:45.925534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e6bfad91-0eec-4938-984f-1f81ed71fba3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:45.926868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e6bfad91-0eec-4938-984f-1f81ed71fba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:45.954479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae970c6423854d0e8dd814cdccbaf7b7', 'request_id': 'req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:45.964915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae970c6423854d0e8dd814cdccbaf7b7', 'request_id': 'req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.000028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1091/2197] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:46.007988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824728f-4750-4074-9a02-8bfdd47e3862 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.010085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824728f-4750-4074-9a02-8bfdd47e3862 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.010085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824728f-4750-4074-9a02-8bfdd47e3862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.027927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-2824728f-4750-4074-9a02-8bfdd47e3862 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:46.029109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2824728f-4750-4074-9a02-8bfdd47e3862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.037160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1092/2198] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:46.041592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824728f-4750-4074-9a02-8bfdd47e3862 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.050057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824728f-4750-4074-9a02-8bfdd47e3862 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.055005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.055744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.056029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.056387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.057172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:46.057477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.059230 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.071233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1093/2199] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:16:46.078521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.093167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f001a9-8605-48e5-955f-06bfbaa3d1d1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.099624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.100262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.100550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.101410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.102141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.108324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.133576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae970c6423854d0e8dd814cdccbaf7b7', 'request_id': 'req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.159458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] The token cache is being invalidate because project ae970c6423854d0e8dd814cdccbaf7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:46.160495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.161902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9b95f1ea-a274-466c-a1ad-b44b9de8cdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.168908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1107/2200] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:45 2022] DELETE /identity/v3/projects/ae970c6423854d0e8dd814cdccbaf7b7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:46.178841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.179429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.179716 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.205630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:46.205630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.207303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1094/2201] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:46.209310 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.211156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.284479 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1108/2202] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:46.285370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.286776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.293285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfe247-ae92-495c-9c25-450728699f59 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.299364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f157bc4-8bdf-4ad8-b7cb-39298857b6e1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.301333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.302735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.303022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.303750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] PATH_INFO: `/v3/projects/527d27a69f1a4d919930aed5ef2a0bf3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.304959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527d27a69f1a4d919930aed5ef2a0bf3)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.305168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abdcf-066b-4fe2-b829-bfdf22c3eaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.305901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abdcf-066b-4fe2-b829-bfdf22c3eaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.307035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abdcf-066b-4fe2-b829-bfdf22c3eaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.307542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abdcf-066b-4fe2-b829-bfdf22c3eaa2 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.308272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abdcf-066b-4fe2-b829-bfdf22c3eaa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.309141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.310441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abdcf-066b-4fe2-b829-bfdf22c3eaa2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.423138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1109/2203] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/users => generated 281 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:46.424657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef08cb-457d-4140-8013-9b6fe46afee5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.424944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef08cb-457d-4140-8013-9b6fe46afee5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.425218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef08cb-457d-4140-8013-9b6fe46afee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.437343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527d27a69f1a4d919930aed5ef2a0bf3', 'request_id': 'req-3060c9a9-d883-470e-8875-e165f3328b17'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.443767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e9ef08cb-457d-4140-8013-9b6fe46afee5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:46.445053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e9ef08cb-457d-4140-8013-9b6fe46afee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.502280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1110/2204] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:46.503142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef08cb-457d-4140-8013-9b6fe46afee5 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.512834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef08cb-457d-4140-8013-9b6fe46afee5 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.517399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.518036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.518320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.518597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.519344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.520932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.531134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1111/2205] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:46.531934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.541495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34a02-16da-4d87-a3f8-6e3fe64267b4 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.546115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.546796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.547075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.547347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.548060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:46.548363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.549940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.564401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1112/2206] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:16:46.565261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.577153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7651-a5ab-4a03-8e35-3c30a617da01 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.581696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.582344 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.582697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.582917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.583618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.585161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.594874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1113/2207] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:46.595623 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.600286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527d27a69f1a4d919930aed5ef2a0bf3', 'request_id': 'req-3060c9a9-d883-470e-8875-e165f3328b17'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.608685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ad89-d733-4fe7-a142-62655b904d34 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.608798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527d27a69f1a4d919930aed5ef2a0bf3', 'request_id': 'req-3060c9a9-d883-470e-8875-e165f3328b17'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.611051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.611753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.612034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.612306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.613334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.615023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.620517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] The token cache is being invalidate because project 527d27a69f1a4d919930aed5ef2a0bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:46.620897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.621735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:46.626507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1095/2208] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:46 2022] DELETE /identity/v3/projects/527d27a69f1a4d919930aed5ef2a0bf3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:46.626507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.632069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.645301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c9a9-d883-470e-8875-e165f3328b17 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.651806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.652713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.653325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.653325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] PATH_INFO: `/v3/projects/153cafb569fe45c19804cf5780627803/users/8a8b4fa9ea8f4af88e0104d9da79de06/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.671178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=153cafb569fe45c19804cf5780627803, user_id=8a8b4fa9ea8f4af88e0104d9da79de06, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.673736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.730869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1114/2209] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:46.730869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.732481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.750811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1096/2210] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:46 2022] PUT /identity/v3/projects/153cafb569fe45c19804cf5780627803/users/8a8b4fa9ea8f4af88e0104d9da79de06/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:46.751829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:46.753777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:46.820612 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950c6a-6766-4588-b236-70210e76f401 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.826759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48198495-2679-4eac-8fb4-4c305a5c5feb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:46.826918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.827782 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.828062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.828339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] PATH_INFO: `/v3/users/4f9b4046a5534904a64558f8cad9e7d8` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.829554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9b4046a5534904a64558f8cad9e7d8)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.831507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.831982 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c91266-5a39-4df1-b201-a1f0baca83b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:46.832736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c91266-5a39-4df1-b201-a1f0baca83b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.833089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c91266-5a39-4df1-b201-a1f0baca83b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.833434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c91266-5a39-4df1-b201-a1f0baca83b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:46.834208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c91266-5a39-4df1-b201-a1f0baca83b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:46.836158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c91266-5a39-4df1-b201-a1f0baca83b9 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:46.977721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1097/2211] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:46.979671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:46.979963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:46.980241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.008049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] MFA Rules not processed for user `8a8b4fa9ea8f4af88e0104d9da79de06`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:47.009318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.076894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1098/2212] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:47.079513 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.080829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.099647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9b4046a5534904a64558f8cad9e7d8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.100346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9b4046a5534904a64558f8cad9e7d8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.108636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9b4046a5534904a64558f8cad9e7d8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.109389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d35d-eed9-4ebf-a19c-3d3c456101cb None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:47.114398 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:47.115366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.115649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.115979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] PATH_INFO: `/v3/users/b4957ed9ec9f4c368b89c75789fdda27` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.117179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4957ed9ec9f4c368b89c75789fdda27)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:47.119150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:47.199584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9b4046a5534904a64558f8cad9e7d8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.200585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9b4046a5534904a64558f8cad9e7d8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.220177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1115/2213] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:46 2022] DELETE /identity/v3/users/4f9b4046a5534904a64558f8cad9e7d8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:47.223359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.224191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.305746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cc372-4de5-413b-bbbb-0bcd7a34f097 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:47.311498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:47.312237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.312490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.314130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.314910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:47.316535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:47.329971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1116/2214] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:47.329971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.329971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.367138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4957ed9ec9f4c368b89c75789fdda27'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.388109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef03921-2468-4089-8d3d-70eb884ee3bc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:47.391696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:47.392335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.392613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.392885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.394677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.452245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:47.453689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:47.463855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1117/2215] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:47.467247 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.479647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929b699-7283-40f7-a7cc-133ddc9334b3 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:47.484240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:47.485042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.485322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.485624 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.486500 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:47.487994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:47.496025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4957ed9ec9f4c368b89c75789fdda27'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.511485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1118/2216] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:47.511485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.513487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.528701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4957ed9ec9f4c368b89c75789fdda27'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.529458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4957ed9ec9f4c368b89c75789fdda27'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.529652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc9d1c-4594-4fef-82e6-c7486eb3b273 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:47.530168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4957ed9ec9f4c368b89c75789fdda27'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.535372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:47.536164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.536450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.536724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] PATH_INFO: `/v3/users/8a8b4fa9ea8f4af88e0104d9da79de06` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.538126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8b4fa9ea8f4af88e0104d9da79de06)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:47.540286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:47.544136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1099/2217] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:47 2022] DELETE /identity/v3/users/b4957ed9ec9f4c368b89c75789fdda27 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:47.546111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.546591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.614834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5435e61-2621-4d23-a953-6cd8658b49b8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:47.619649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8147-c560-47c9-9cb0-87d3a9162b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:47.620540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8147-c560-47c9-9cb0-87d3a9162b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.620819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8147-c560-47c9-9cb0-87d3a9162b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.621092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8147-c560-47c9-9cb0-87d3a9162b56 admin admin] PATH_INFO: `/v3/projects/fb962ac798774e059b37301b19dcde70/users/ecad7153f0d44ca9b2e141bcca2062d9/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.638196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d8147-c560-47c9-9cb0-87d3a9162b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb962ac798774e059b37301b19dcde70, user_id=ecad7153f0d44ca9b2e141bcca2062d9, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:47.640776 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d8147-c560-47c9-9cb0-87d3a9162b56 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:47.781004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1100/2218] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:47 2022] PUT /identity/v3/projects/fb962ac798774e059b37301b19dcde70/users/ecad7153f0d44ca9b2e141bcca2062d9/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:47.782725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9ec2-9453-4e92-8dc7-bd6e7886ddb4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.783016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9ec2-9453-4e92-8dc7-bd6e7886ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.783291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9ec2-9453-4e92-8dc7-bd6e7886ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.803309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-31fc9ec2-9453-4e92-8dc7-bd6e7886ddb4 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:47.809381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-31fc9ec2-9453-4e92-8dc7-bd6e7886ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.883904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1101/2219] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:47.883904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:47.883904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:47.883904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:47.888037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8b4fa9ea8f4af88e0104d9da79de06'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.888860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8b4fa9ea8f4af88e0104d9da79de06'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.897222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8b4fa9ea8f4af88e0104d9da79de06'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.912283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] MFA Rules not processed for user `ecad7153f0d44ca9b2e141bcca2062d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:47.913498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.954106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8b4fa9ea8f4af88e0104d9da79de06'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.955252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8b4fa9ea8f4af88e0104d9da79de06'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:47.979175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1119/2220] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:47 2022] DELETE /identity/v3/users/8a8b4fa9ea8f4af88e0104d9da79de06 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:47.980548 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.982402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:47.990473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1102/2221] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:47.998195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:47.998195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.077780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bbe63-eb93-41ea-b45d-a16e5203d560 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.090379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3adbfe-44b1-415e-a415-b652beebf1d8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.105162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.106100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.106384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.106681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] PATH_INFO: `/v3/projects/a4e5bafd6a3e41fa91dd2a78f15b9c2f` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.114287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e5bafd6a3e41fa91dd2a78f15b9c2f)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.116334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.157605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aefde-c4e1-45ef-8d71-f88894954035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.158451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefde-c4e1-45ef-8d71-f88894954035 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.158814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefde-c4e1-45ef-8d71-f88894954035 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.159025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefde-c4e1-45ef-8d71-f88894954035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.161025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5b4aefde-c4e1-45ef-8d71-f88894954035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.174880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4aefde-c4e1-45ef-8d71-f88894954035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.176337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4aefde-c4e1-45ef-8d71-f88894954035 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.188069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1103/2222] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:48.188408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.188680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.188960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.212942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:48.214409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.223112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1104/2223] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:48.224012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.227229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.243094 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225727-7d19-4e09-a2ce-5c8db4dfa07d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.252490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.252490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.252490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.252490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.252911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.254927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.273259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e5bafd6a3e41fa91dd2a78f15b9c2f', 'request_id': 'req-8dffdbc6-92db-4ef3-adfb-5899325db633'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:48.282945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e5bafd6a3e41fa91dd2a78f15b9c2f', 'request_id': 'req-8dffdbc6-92db-4ef3-adfb-5899325db633'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:48.367198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1105/2224] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:48 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:48.368039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.392559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e5bafd6a3e41fa91dd2a78f15b9c2f', 'request_id': 'req-8dffdbc6-92db-4ef3-adfb-5899325db633'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:48.405362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] The token cache is being invalidate because project a4e5bafd6a3e41fa91dd2a78f15b9c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:48.405717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:48.406318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:48.409216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1120/2225] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:47 2022] DELETE /identity/v3/projects/a4e5bafd6a3e41fa91dd2a78f15b9c2f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:48.409715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.411895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.442490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b165ab7-c54a-4391-a078-1241020489d8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.448318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bae70-da8a-450b-a363-fba85b29b40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.449576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bae70-da8a-450b-a363-fba85b29b40e service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.450209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bae70-da8a-450b-a363-fba85b29b40e service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.450543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bae70-da8a-450b-a363-fba85b29b40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.452987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a37bae70-da8a-450b-a363-fba85b29b40e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.533946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffdbc6-92db-4ef3-adfb-5899325db633 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.542150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bae70-da8a-450b-a363-fba85b29b40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.544312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bae70-da8a-450b-a363-fba85b29b40e service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.550040 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.550745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.551043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.551300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.551998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.554107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.559721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1106/2226] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:48.561794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075fb6e-4bc4-41af-9928-c51ef184001b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.562108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075fb6e-4bc4-41af-9928-c51ef184001b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.562394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075fb6e-4bc4-41af-9928-c51ef184001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.584741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d075fb6e-4bc4-41af-9928-c51ef184001b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:48.586120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d075fb6e-4bc4-41af-9928-c51ef184001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.604380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1107/2227] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:48.605923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7cf5-7f15-40dc-9e9a-14042695ede8 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.606222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7cf5-7f15-40dc-9e9a-14042695ede8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.606504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7cf5-7f15-40dc-9e9a-14042695ede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.625462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-721d7cf5-7f15-40dc-9e9a-14042695ede8 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:48.626762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-721d7cf5-7f15-40dc-9e9a-14042695ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.636878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1108/2228] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:48.640798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7cf5-7f15-40dc-9e9a-14042695ede8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.650682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7cf5-7f15-40dc-9e9a-14042695ede8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.655658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.656308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.660278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.660278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.660278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:48.660278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.660278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.671753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1109/2229] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:16:48.676048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.685387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba74891-b0dd-4d1b-bdc7-1f405433ee14 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.689876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.690539 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.690896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.691320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.691849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.693732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.698656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1121/2230] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:48 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:48.703037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.713665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338d75e-771f-4aeb-9244-22300e9c0996 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.718698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.719374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.719659 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.719939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.720693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.722376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.732884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1122/2231] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:16:48.737403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.747987 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ee34-32de-4907-a7eb-216cc208f49f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.752678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.753350 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.753629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.753909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.754692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.756291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.772541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1123/2232] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:16:48.775985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.778093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:48.796202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3dc79-9e4a-45de-bb60-5eb758638cda admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.809505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.815163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.815163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.815163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] PATH_INFO: `/v3/projects/7db0ac9e7cca4a75b882e7189bf2e374` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.815163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db0ac9e7cca4a75b882e7189bf2e374)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.816730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:48.833221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1110/2233] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:48 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:48.834570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:48.903007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55b1f4-c8d1-4de6-8489-9e8a7d060399 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:48.907856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:48.909086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:48.909435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:48.909719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] PATH_INFO: `/v3/projects/316841b1979241819e9ec5f26e713972/users/16d28522c8f44584a0435b780ce1a5f9/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:48.926950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316841b1979241819e9ec5f26e713972, user_id=16d28522c8f44584a0435b780ce1a5f9, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:48.929864 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.024103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1111/2234] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:48 2022] PUT /identity/v3/projects/316841b1979241819e9ec5f26e713972/users/16d28522c8f44584a0435b780ce1a5f9/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:49.025520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.036257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db0ac9e7cca4a75b882e7189bf2e374', 'request_id': 'req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.045060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db0ac9e7cca4a75b882e7189bf2e374', 'request_id': 'req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.131854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db0ac9e7cca4a75b882e7189bf2e374', 'request_id': 'req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.141905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c0c6a-da6b-4a97-a0d0-246fcfcb4453 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.145210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] The token cache is being invalidate because project 7db0ac9e7cca4a75b882e7189bf2e374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:49.145501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.146782 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0eda662a-bca8-4dc9-9b20-0e2dbd01835d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.150795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1124/2235] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:48 2022] DELETE /identity/v3/projects/7db0ac9e7cca4a75b882e7189bf2e374 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:49.150795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.150795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.150795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.208049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] MFA Rules not processed for user `16d28522c8f44584a0435b780ce1a5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:49.221786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.221897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.221897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.221897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.222823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.223908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.226921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.328671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1112/2236] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:49 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:49.332399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.340830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.365281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88755d-a9a1-43e8-8ee8-dff80f846179 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.375375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.376276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.376559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.376841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] PATH_INFO: `/v3/projects/153cafb569fe45c19804cf5780627803` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.378248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=153cafb569fe45c19804cf5780627803)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.381777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.398140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1125/2237] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:49.399058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.402005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.420759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0ea58-f5eb-4a4e-81ff-4ba86957c293 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.426341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.427131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.427499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.427840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.428660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.430469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.443969 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1126/2238] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:49.444816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.448595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.463763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c16d-8937-4670-bdab-9bf0735540ad admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.469852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.469852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.470168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.470637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.471429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.473418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.528370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153cafb569fe45c19804cf5780627803', 'request_id': 'req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.596494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1127/2239] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:49 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:49.597190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.616868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153cafb569fe45c19804cf5780627803', 'request_id': 'req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.623684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153cafb569fe45c19804cf5780627803', 'request_id': 'req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.637841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] The token cache is being invalidate because project 153cafb569fe45c19804cf5780627803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:49.638130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.638833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:49.644053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1113/2240] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:49 2022] DELETE /identity/v3/projects/153cafb569fe45c19804cf5780627803 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:49.644053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.645437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.667547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2deb3-5df3-4d41-940a-72a74ae6c1fa admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.674298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce39e9-fd9c-4dc6-b46b-2562b06658b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.675016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce39e9-fd9c-4dc6-b46b-2562b06658b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.676531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce39e9-fd9c-4dc6-b46b-2562b06658b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.676866 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce39e9-fd9c-4dc6-b46b-2562b06658b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.677680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce39e9-fd9c-4dc6-b46b-2562b06658b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.679303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce39e9-fd9c-4dc6-b46b-2562b06658b1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.690367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1128/2241] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:49.691956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.692531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.693037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.713912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:49.715332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.730732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1129/2242] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:49.730732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.731421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe473d0-ef8a-42b9-ad9f-eec46eca5c86 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.731505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.733362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea1bef-4ccb-43a6-8fcf-8c503d32f74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.733362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea1bef-4ccb-43a6-8fcf-8c503d32f74a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.733362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea1bef-4ccb-43a6-8fcf-8c503d32f74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.733362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea1bef-4ccb-43a6-8fcf-8c503d32f74a admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.733770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea1bef-4ccb-43a6-8fcf-8c503d32f74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.735795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea1bef-4ccb-43a6-8fcf-8c503d32f74a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.739839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49369a4-526c-4acc-a05d-cb18110a6de1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.745138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.746057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.746333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.746655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] PATH_INFO: `/v3/projects/1c8ac39bfa2d44d7b043bff02b6ed8f2/users/1a953eac9731498cba4b544bc8e737f0/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.762171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8ac39bfa2d44d7b043bff02b6ed8f2, user_id=1a953eac9731498cba4b544bc8e737f0, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.767212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.863254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1114/2243] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:49 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:49.864828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409710-f780-4fcd-81ed-2e74f7720314 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.865117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409710-f780-4fcd-81ed-2e74f7720314 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.865396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409710-f780-4fcd-81ed-2e74f7720314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.881570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1130/2244] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:49 2022] PUT /identity/v3/projects/1c8ac39bfa2d44d7b043bff02b6ed8f2/users/1a953eac9731498cba4b544bc8e737f0/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:49.882776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.885351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-42409710-f780-4fcd-81ed-2e74f7720314 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:49.886537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-42409710-f780-4fcd-81ed-2e74f7720314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.951144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1115/2245] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:49.952422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95d6-fd8c-4024-a51c-cc3bb622636a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.952712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95d6-fd8c-4024-a51c-cc3bb622636a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.953056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d95d6-fd8c-4024-a51c-cc3bb622636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.953562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872014-9275-4690-be20-cf85cc44785a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.958419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.959178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.959462 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.959740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.960481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.962726 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:49.973791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1131/2246] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:49.975081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:49.980840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-696d95d6-fd8c-4024-a51c-cc3bb622636a None None] MFA Rules not processed for user `1a953eac9731498cba4b544bc8e737f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:49.982130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-696d95d6-fd8c-4024-a51c-cc3bb622636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:49.985904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2943b7f-db47-41c6-b9d7-400c03cf2923 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:49.992336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:49.999272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:49.999272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:49.999272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:49.999272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:49.999272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:49.999272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.010795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1132/2247] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:16:50.011769 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.023468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42761a9c-2d52-4f8b-a127-632ced3496a4 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.029306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.030243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.030551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.030883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] PATH_INFO: `/v3/projects/25c96a12b3594a50b9a6cee5e14e0464/users/2f9f4aca7ef04ddfb0751e05126e64aa/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.051326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c96a12b3594a50b9a6cee5e14e0464, user_id=2f9f4aca7ef04ddfb0751e05126e64aa, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.057510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.064731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1116/2248] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:50.066329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d95d6-fd8c-4024-a51c-cc3bb622636a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.078893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d95d6-fd8c-4024-a51c-cc3bb622636a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.090999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.090999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.090999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.090999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.091503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.091503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.160271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1133/2249] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:50 2022] PUT /identity/v3/projects/25c96a12b3594a50b9a6cee5e14e0464/users/2f9f4aca7ef04ddfb0751e05126e64aa/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:50.161246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.201954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1117/2250] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:50 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:50.203089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.233653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6d2e-249a-43ec-95c4-809fa382088c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.276953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed551475-2c03-4259-bd3d-ef518b7eac4e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.283320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.284003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.284502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.284615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.285274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.287083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.301042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1118/2251] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:50.301042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.307482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.317501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.317501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.317501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.317501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.317987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d44cb-765b-4f6d-9dc7-a2d3c4fbe0f8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.318083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.318176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.318176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.318351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.318542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.319289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.322436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.468494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1134/2252] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:50 2022] POST /identity/v3/projects => generated 363 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:50.469602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.535237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b7468-01b4-4d31-93fa-4a905a5c0db3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.537185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1119/2253] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:50 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:50.540932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.541621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.542546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.543301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.543301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] PATH_INFO: `/v3/projects/25c96a12b3594a50b9a6cee5e14e0464/users/2f9f4aca7ef04ddfb0751e05126e64aa/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.545217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c96a12b3594a50b9a6cee5e14e0464, user_id=2f9f4aca7ef04ddfb0751e05126e64aa, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.548177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.560947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1135/2254] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:50 2022] PUT /identity/v3/projects/25c96a12b3594a50b9a6cee5e14e0464/users/2f9f4aca7ef04ddfb0751e05126e64aa/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:50.562550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.584923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523f0ed-06f4-4ac1-9767-34cd5195f222 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.673261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4c93-1d8b-4189-8f7a-383c43374677 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.682938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a125e-63aa-4fe0-ab4b-957b42b07094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.683682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a125e-63aa-4fe0-ab4b-957b42b07094 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.684014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.684140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a125e-63aa-4fe0-ab4b-957b42b07094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.684292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a125e-63aa-4fe0-ab4b-957b42b07094 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.685159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a125e-63aa-4fe0-ab4b-957b42b07094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.685271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.685733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.686181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.687024 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a125e-63aa-4fe0-ab4b-957b42b07094 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.687449 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.690194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.709025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1136/2255] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:50.709025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237a4e-116d-42e5-aebb-8cba644d0363 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.709025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237a4e-116d-42e5-aebb-8cba644d0363 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.709025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237a4e-116d-42e5-aebb-8cba644d0363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.741138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d2237a4e-116d-42e5-aebb-8cba644d0363 None None] MFA Rules not processed for user `2f9f4aca7ef04ddfb0751e05126e64aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:50.742222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d2237a4e-116d-42e5-aebb-8cba644d0363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:50.814325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1120/2256] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:50 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:50.815372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.831101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74586a2f-cfbb-49c1-915d-7739dbd559ef admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.834820 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1137/2257] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:50.835965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2237a4e-116d-42e5-aebb-8cba644d0363 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.838343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.839126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.839840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.839840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.840595 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.844136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.849941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2237a4e-116d-42e5-aebb-8cba644d0363 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.854949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.855897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.856145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.856428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.857617 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.859828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.864280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1121/2258] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:50.864280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.871186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:50.873576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1138/2259] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:50.874496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:50.885487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661d8a-53d9-4ca1-8328-d7cc967109d2 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.890648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.892016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.892310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.892588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] PATH_INFO: `/v3/projects/80bdb68d492243238486145e4267480c/users/e5a889d1e32d46b88cc162e23e05f770/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.910146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bdb68d492243238486145e4267480c, user_id=e5a889d1e32d46b88cc162e23e05f770, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:50.913028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:50.963321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4285dde-1600-435e-b972-dd0c588a5fd2 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:50.967719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d331-e4b2-47cc-aec7-a8ca916ccf08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:50.968379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d331-e4b2-47cc-aec7-a8ca916ccf08 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:50.978273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d331-e4b2-47cc-aec7-a8ca916ccf08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:50.978273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d331-e4b2-47cc-aec7-a8ca916ccf08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:50.978273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bfc0d331-e4b2-47cc-aec7-a8ca916ccf08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:51.004017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1139/2260] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:50 2022] PUT /identity/v3/projects/80bdb68d492243238486145e4267480c/users/e5a889d1e32d46b88cc162e23e05f770/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:51.005079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:51.044196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d331-e4b2-47cc-aec7-a8ca916ccf08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:51.045786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d331-e4b2-47cc-aec7-a8ca916ccf08 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:51.059367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1122/2261] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:51.060911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:51.061363 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:51.061745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:51.079042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac2fb3-d2f7-4bb3-9a9a-de9f180bf154 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:51.084692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:51.086384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:51.086720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:51.087044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] PATH_INFO: `/v3/projects/102c3e6642a4455fa063ee852c6073da/users/dee37f73af9343ec8c45d31d7b92175e/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:51.094378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] MFA Rules not processed for user `e5a889d1e32d46b88cc162e23e05f770`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:51.095873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:51.105154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=102c3e6642a4455fa063ee852c6073da, user_id=dee37f73af9343ec8c45d31d7b92175e, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:51.107885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:51.169123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1123/2262] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:51.181138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:51.182542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:51.194402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1140/2263] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:51 2022] PUT /identity/v3/projects/102c3e6642a4455fa063ee852c6073da/users/dee37f73af9343ec8c45d31d7b92175e/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:51.199644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:51.276547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbb3db-1a1b-4c67-84d8-9a74b45e2daa admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:51.288558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc21d-2b28-49ff-b7fa-1329b9559c2d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:51.288757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:51.289480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:51.289765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:51.290567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:51.291325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:51.293187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:51.306402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1141/2264] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:51.317475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:51.329464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69844b-7454-42ef-a7fd-fce0321fa269 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:51.334544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512203f6-41cf-4fbf-a075-4825d242c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:51.335605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512203f6-41cf-4fbf-a075-4825d242c15d admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:51.335978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512203f6-41cf-4fbf-a075-4825d242c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:51.336326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512203f6-41cf-4fbf-a075-4825d242c15d admin admin] PATH_INFO: `/v3/projects/102c3e6642a4455fa063ee852c6073da/users/dee37f73af9343ec8c45d31d7b92175e/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:51.339679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512203f6-41cf-4fbf-a075-4825d242c15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=102c3e6642a4455fa063ee852c6073da, user_id=dee37f73af9343ec8c45d31d7b92175e, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:51.341740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512203f6-41cf-4fbf-a075-4825d242c15d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:51.355476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bfec7fb739b42bfa2ddd682aa10dc95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:51.356139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:51.356420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:51.356693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:51.390528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1142/2265] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:51 2022] PUT /identity/v3/projects/102c3e6642a4455fa063ee852c6073da/users/dee37f73af9343ec8c45d31d7b92175e/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:51.401656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601bb3-c5e0-4a73-b99a-dcfb627d67f7 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:51.401998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601bb3-c5e0-4a73-b99a-dcfb627d67f7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:51.402282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601bb3-c5e0-4a73-b99a-dcfb627d67f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:51.431328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:51.432501 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:51.434706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9d601bb3-c5e0-4a73-b99a-dcfb627d67f7 None None] MFA Rules not processed for user `dee37f73af9343ec8c45d31d7b92175e`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:51.436052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9d601bb3-c5e0-4a73-b99a-dcfb627d67f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:51.444378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1124/2266] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:51.524515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1143/2267] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:51.809508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:51.892750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3428-60e7-4e89-a509-f5ca4eed43d3 service glance] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:51.984560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:51.985383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:51.985669 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:51.986035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:52.008045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:52.014748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:52.038820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1125/2268] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:52.390406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601bb3-c5e0-4a73-b99a-dcfb627d67f7 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:52.401117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601bb3-c5e0-4a73-b99a-dcfb627d67f7 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:52.404874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:52.405529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:52.405809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:52.406085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:52.462777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:52.464128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:52.473304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1144/2269] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:54.781270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:54.782732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:54.794865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeeaa0-ede6-4754-8013-958620d9317a service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:54.798626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:54.799452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:54.799801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:54.800149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:54.802245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:54.862483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:54.863994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:54.872678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1126/2270] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:56.603713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:56.665732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:56.666229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d72a9-f669-4a3a-bde2-c6c6bbbda4db service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:56.670469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:56.672016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:56.678735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:56.678735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] PATH_INFO: `/v3/users/1a953eac9731498cba4b544bc8e737f0` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:56.678735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a953eac9731498cba4b544bc8e737f0)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:56.679019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c52c4d-082b-4618-a377-d0911db2aabd service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:56.679127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:56.679244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62dc62c-5583-4315-a3a4-a1502b20c2bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:56.679244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dc62c-5583-4315-a3a4-a1502b20c2bb service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:56.679244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dc62c-5583-4315-a3a4-a1502b20c2bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:56.679244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dc62c-5583-4315-a3a4-a1502b20c2bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:56.747985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62dc62c-5583-4315-a3a4-a1502b20c2bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:56.750269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62dc62c-5583-4315-a3a4-a1502b20c2bb service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:56.761743 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1127/2271] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:16:57.007514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a953eac9731498cba4b544bc8e737f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:57.008240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a953eac9731498cba4b544bc8e737f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:57.018307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a953eac9731498cba4b544bc8e737f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:57.095720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a953eac9731498cba4b544bc8e737f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:57.097096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a953eac9731498cba4b544bc8e737f0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:57.118858 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1145/2272] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:56 2022] DELETE /identity/v3/users/1a953eac9731498cba4b544bc8e737f0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:57.123382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:57.123675 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:57.123957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:57.142067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:57.143395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:57.211669 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1128/2273] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:57.223593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:57.225039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:57.288704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d14c-ab24-4ed6-9283-b77e696e5035 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:57.293271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:57.294009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:57.294315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:57.294590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:57.307061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:57.308543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:57.318770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1146/2274] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:16:57.809731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:57.811182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:57.824126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081d9e5-a628-454b-aa6b-df9784d63782 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:57.837348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:57.839087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:57.839087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:57.839087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] PATH_INFO: `/v3/users/a5e973ae9ecc46f5b2145d8db14249dc` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:57.843345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e973ae9ecc46f5b2145d8db14249dc)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:57.851445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:57.855293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:57.857242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:57.872709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c9410-4174-49da-9dec-4978eaa16410 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:57.878286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:57.879931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:57.880214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:57.880928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] PATH_INFO: `/v3/projects/1c8ac39bfa2d44d7b043bff02b6ed8f2` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:57.881827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8ac39bfa2d44d7b043bff02b6ed8f2)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:57.885429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:58.085949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e973ae9ecc46f5b2145d8db14249dc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.091561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8ac39bfa2d44d7b043bff02b6ed8f2', 'request_id': 'req-e833cac1-db30-422e-ae75-b7402b580654'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.121232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8ac39bfa2d44d7b043bff02b6ed8f2', 'request_id': 'req-e833cac1-db30-422e-ae75-b7402b580654'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.146325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e973ae9ecc46f5b2145d8db14249dc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.162183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e973ae9ecc46f5b2145d8db14249dc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.162957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e973ae9ecc46f5b2145d8db14249dc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.163572 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e28174a9-f0de-4bdc-9e9e-20b2eef5d776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e973ae9ecc46f5b2145d8db14249dc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.185806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1129/2275] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:57 2022] DELETE /identity/v3/users/a5e973ae9ecc46f5b2145d8db14249dc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:58.187618 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:58.187987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:58.188328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:58.206066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:58.207291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:58.223357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8ac39bfa2d44d7b043bff02b6ed8f2', 'request_id': 'req-e833cac1-db30-422e-ae75-b7402b580654'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.236575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] The token cache is being invalidate because project 1c8ac39bfa2d44d7b043bff02b6ed8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:58.236938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.237650 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.239305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1147/2276] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:57 2022] DELETE /identity/v3/projects/1c8ac39bfa2d44d7b043bff02b6ed8f2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:58.243986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:58.245441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:58.267447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1130/2277] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:16:58.277414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:58.282924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:58.331289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833cac1-db30-422e-ae75-b7402b580654 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:58.339096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:58.340622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:58.341087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:58.341568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] PATH_INFO: `/v3/users/dee37f73af9343ec8c45d31d7b92175e` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:58.343669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee37f73af9343ec8c45d31d7b92175e)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:58.347223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:58.373907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97c98-7f64-48f9-8710-598d4ec03f07 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:58.380430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:58.381447 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:58.381913 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:58.382371 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:58.395516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:58.397685 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:58.408583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1131/2278] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:16:58.629027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee37f73af9343ec8c45d31d7b92175e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.632093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee37f73af9343ec8c45d31d7b92175e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.636492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee37f73af9343ec8c45d31d7b92175e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.735333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee37f73af9343ec8c45d31d7b92175e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.735333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee37f73af9343ec8c45d31d7b92175e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:58.752841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1148/2279] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:16:58 2022] DELETE /identity/v3/users/dee37f73af9343ec8c45d31d7b92175e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:58.870438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:58.872233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:58.898470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211227-2523-4fe3-9111-138276f4e362 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:58.980299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:58.981273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:58.981651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:58.982046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] PATH_INFO: `/v3/projects/0389ef682d85435e8321a277daf0218c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:58.983368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0389ef682d85435e8321a277daf0218c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:58.985435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.162548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0389ef682d85435e8321a277daf0218c', 'request_id': 'req-c86f5469-7d48-4d02-964c-7404e5c80d0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.231186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0389ef682d85435e8321a277daf0218c', 'request_id': 'req-c86f5469-7d48-4d02-964c-7404e5c80d0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.241527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.241974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0389ef682d85435e8321a277daf0218c', 'request_id': 'req-c86f5469-7d48-4d02-964c-7404e5c80d0b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.243008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:59.255560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] The token cache is being invalidate because project 0389ef682d85435e8321a277daf0218c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:59.255953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.257220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c86f5469-7d48-4d02-964c-7404e5c80d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.257873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bbf0b-5eda-4d1f-aa63-6a227af44f25 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.258603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1132/2280] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:58 2022] DELETE /identity/v3/projects/0389ef682d85435e8321a277daf0218c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:16:59.265159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022523-93c0-482f-8f56-ec56509448e6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.268945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022523-93c0-482f-8f56-ec56509448e6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.272869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022523-93c0-482f-8f56-ec56509448e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.329818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ea022523-93c0-482f-8f56-ec56509448e6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:59.331165 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ea022523-93c0-482f-8f56-ec56509448e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:59.359666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.360894 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.361396 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.361682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] PATH_INFO: `/v3/projects/102c3e6642a4455fa063ee852c6073da` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.362936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] RBAC: Authorizing `identity:delete_project(project_id=102c3e6642a4455fa063ee852c6073da)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.364887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.397444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1133/2281] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:59.409936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25654-9a45-4c70-a1d9-2601ff4d7435 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.410227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25654-9a45-4c70-a1d9-2601ff4d7435 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.410505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25654-9a45-4c70-a1d9-2601ff4d7435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.427924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-aee25654-9a45-4c70-a1d9-2601ff4d7435 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:59.429103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-aee25654-9a45-4c70-a1d9-2601ff4d7435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:59.437122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1134/2282] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:59.441015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee25654-9a45-4c70-a1d9-2601ff4d7435 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.450253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee25654-9a45-4c70-a1d9-2601ff4d7435 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.454845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.455471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.455753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.456028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.456738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:59.457040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.458644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.473783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1135/2283] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:16:59.477038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.486835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded37b6-3d13-4bd2-b82f-509b546ce7c6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.491741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.492532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.492784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.493063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.493860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.495982 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.513991 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102c3e6642a4455fa063ee852c6073da', 'request_id': 'req-7c875a89-b69c-46c4-b58e-a1446ad0bcce'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.519530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102c3e6642a4455fa063ee852c6073da', 'request_id': 'req-7c875a89-b69c-46c4-b58e-a1446ad0bcce'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.615807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102c3e6642a4455fa063ee852c6073da', 'request_id': 'req-7c875a89-b69c-46c4-b58e-a1446ad0bcce'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.630157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1136/2284] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:16:59.631976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.634700 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] The token cache is being invalidate because project 102c3e6642a4455fa063ee852c6073da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:16:59.635171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.636090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7c875a89-b69c-46c4-b58e-a1446ad0bcce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:16:59.638841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1149/2285] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:16:59 2022] DELETE /identity/v3/projects/102c3e6642a4455fa063ee852c6073da => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:16:59.649133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c6bc-e241-4531-93d1-c18bba849119 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.649629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c6bc-e241-4531-93d1-c18bba849119 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.650035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c6bc-e241-4531-93d1-c18bba849119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.676123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9e80c6bc-e241-4531-93d1-c18bba849119 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:59.678006 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9e80c6bc-e241-4531-93d1-c18bba849119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:59.747612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233c87a-1975-4e72-bb80-72610f8d1993 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.752704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.753781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.754184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.754468 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.755304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.757810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.760983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1150/2286] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:59.768698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741fc1-f0d4-45ca-abbb-dd6ddab09c67 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.768984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741fc1-f0d4-45ca-abbb-dd6ddab09c67 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.769261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741fc1-f0d4-45ca-abbb-dd6ddab09c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.787235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ef741fc1-f0d4-45ca-abbb-dd6ddab09c67 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:16:59.788409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ef741fc1-f0d4-45ca-abbb-dd6ddab09c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:59.796446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1151/2287] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:16:59.800754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef741fc1-f0d4-45ca-abbb-dd6ddab09c67 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.810539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef741fc1-f0d4-45ca-abbb-dd6ddab09c67 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.815285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.815952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.816239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.816605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.817379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:16:59.817696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.819332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.832238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1152/2288] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:16:59.836632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.861129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1137/2289] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:16:59.863554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.865284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a6ba-5bda-4a95-8945-ea5e4c9bb3b9 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.865533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:16:59.876031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.877172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.877434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.877775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.878950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.881424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.883940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26139f6f-783a-40b0-b3b1-1b04d416cd76 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.902214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.902214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.902214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.902214 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.902829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.902829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.907769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1138/2290] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:16:59.911717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.921548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c28af-3e0c-4c4f-80ba-dd2b0e4405a6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.926213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.926892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.927178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.927454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.928167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.930259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.940986 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1139/2291] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:16:59.945124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:16:59.955778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a8f2e-a0e6-4801-b538-c3d6c93f2553 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:16:59.962048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0093cf-840c-4555-a74a-0ef8c617cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:16:59.963093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0093cf-840c-4555-a74a-0ef8c617cc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:16:59.963372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0093cf-840c-4555-a74a-0ef8c617cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:16:59.963652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0093cf-840c-4555-a74a-0ef8c617cc28 admin admin] PATH_INFO: `/v3/projects/5ff333654b7d41cdb9f8a4101b963ca2/users/5e0d13c4a9ff46cfab08c6cfea2f35dd/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:16:59.980837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0093cf-840c-4555-a74a-0ef8c617cc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff333654b7d41cdb9f8a4101b963ca2, user_id=5e0d13c4a9ff46cfab08c6cfea2f35dd, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:16:59.983606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0093cf-840c-4555-a74a-0ef8c617cc28 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:16:59.998708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1153/2292] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:17:00.000703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.049570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1140/2293] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:16:59 2022] PUT /identity/v3/projects/5ff333654b7d41cdb9f8a4101b963ca2/users/5e0d13c4a9ff46cfab08c6cfea2f35dd/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:00.063724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.064051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.064359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.073182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568aa4-8366-41f9-b87e-5a270b6f331f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.099641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] MFA Rules not processed for user `5e0d13c4a9ff46cfab08c6cfea2f35dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:00.100763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:00.135013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.135725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.136004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.136518 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.137993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.139966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.170954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1141/2294] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:17:00.182751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.184141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:00.221348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1154/2295] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:16:59 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:17:00.229375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.235507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af432484-281d-42ac-a2ac-8beb698b5e68 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.246382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.247340 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.247340 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.247527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.248255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.249104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1e19-770b-4f60-9085-1997f297f87f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.249884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.254593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.255613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.255893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.256162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.261455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1155/2296] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:17:00.265457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.266411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.267868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.276757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b86fa-cffd-4447-9c01-6dc2a834d716 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.278014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1142/2297] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:17:00.281623 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b630a20-48ad-4d5f-8137-7c3644821fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.282280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630a20-48ad-4d5f-8137-7c3644821fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.282992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630a20-48ad-4d5f-8137-7c3644821fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.283227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630a20-48ad-4d5f-8137-7c3644821fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.283954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b630a20-48ad-4d5f-8137-7c3644821fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.285558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b630a20-48ad-4d5f-8137-7c3644821fbd admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.297460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1156/2298] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:17:00.301734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.314427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f3d1b-4fef-4cef-a466-1fdfdaa0b890 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.318896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.319793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.320907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.321059 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] PATH_INFO: `/v3/projects/22c262e17efb4fa79613411d8c09724c/users/68fe23e841ac45bbb5b5939c9b6faaad/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.338210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c262e17efb4fa79613411d8c09724c, user_id=68fe23e841ac45bbb5b5939c9b6faaad, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.341029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.437570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1143/2299] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:00 2022] PUT /identity/v3/projects/22c262e17efb4fa79613411d8c09724c/users/68fe23e841ac45bbb5b5939c9b6faaad/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:00.449313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba053-afd8-4681-bb64-197ffa8b1ad1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.449599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba053-afd8-4681-bb64-197ffa8b1ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.449874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba053-afd8-4681-bb64-197ffa8b1ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.479352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-a03ba053-afd8-4681-bb64-197ffa8b1ad1 None None] MFA Rules not processed for user `68fe23e841ac45bbb5b5939c9b6faaad`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:00.480564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a03ba053-afd8-4681-bb64-197ffa8b1ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:00.545573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1157/2300] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:00.550046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.621879 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eec69b-9ab3-4bc0-85c5-e654caa9ce0c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.626505 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.627193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.627476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.627751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.628450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.630340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.759912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1144/2301] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:00 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:17:00.764022 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba053-afd8-4681-bb64-197ffa8b1ad1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.774946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba053-afd8-4681-bb64-197ffa8b1ad1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.829265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.829927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.830205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.830477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.831203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.833107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.939091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1158/2302] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:00 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:00.940635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.951882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595007-acc9-4187-b97a-3a941f2cd897 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.956916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.957736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.958358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.958358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.958968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.961156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:00.973711 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1145/2303] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:00.978693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:00.988936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0d68-4ca4-4ab9-a32d-f0e953802a9c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:00.994429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba0476-84a2-402a-950b-17c87c911a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:00.995121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0476-84a2-402a-950b-17c87c911a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:00.995404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0476-84a2-402a-950b-17c87c911a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:00.995680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0476-84a2-402a-950b-17c87c911a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:00.996409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba0476-84a2-402a-950b-17c87c911a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:00.998026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba0476-84a2-402a-950b-17c87c911a03 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:01.008104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1159/2304] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:01.012323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:01.022347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192672d-ce71-446c-8cbc-f0b6695552ee admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:01.027030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:01.027952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:01.028181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:01.028455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] PATH_INFO: `/v3/projects/b6685451cfc14721abd5922a3cae6fae/users/407f61648810400ba5b376bcdd9a1a0d/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:01.046338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6685451cfc14721abd5922a3cae6fae, user_id=407f61648810400ba5b376bcdd9a1a0d, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:01.049036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:01.178893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1146/2305] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:01 2022] PUT /identity/v3/projects/b6685451cfc14721abd5922a3cae6fae/users/407f61648810400ba5b376bcdd9a1a0d/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:01.188045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f46a-9e80-4da7-8a77-5df5589e844a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:01.188045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f46a-9e80-4da7-8a77-5df5589e844a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:01.188265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f46a-9e80-4da7-8a77-5df5589e844a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:01.217859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d115f46a-9e80-4da7-8a77-5df5589e844a None None] MFA Rules not processed for user `407f61648810400ba5b376bcdd9a1a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:01.219192 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d115f46a-9e80-4da7-8a77-5df5589e844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:01.292107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1160/2306] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:01.296716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:01.368560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9e995-88b9-4e99-928a-3b96a5b0f080 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:01.373647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:01.374370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:01.374687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:01.374966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:01.375667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:01.377561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:01.532920 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1147/2307] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:01 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:01.536745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115f46a-9e80-4da7-8a77-5df5589e844a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:01.548625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115f46a-9e80-4da7-8a77-5df5589e844a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:01.612429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:01.613312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:01.613715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:01.614054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:01.614918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:01.617750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:01.702941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1161/2308] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:01 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:17:01.707062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:01.725434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc54655-0083-4901-b19e-03d35dfe8832 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:01.731778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:01.732528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:01.732817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:01.733118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:01.733853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:01.739025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:01.752263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1148/2309] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:01.753576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:01.772407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff964cc-6385-41d3-bb99-831cbf601b0c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:01.779530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:01.780487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:01.780821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:01.781252 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] PATH_INFO: `/v3/projects/abc62176b4d94b7e843b423f7a4d6c60/users/b00057c1a21e47fb89ba725d19671377/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:01.808603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc62176b4d94b7e843b423f7a4d6c60, user_id=b00057c1a21e47fb89ba725d19671377, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:01.811315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:01.940146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1162/2310] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:01 2022] PUT /identity/v3/projects/abc62176b4d94b7e843b423f7a4d6c60/users/b00057c1a21e47fb89ba725d19671377/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:01.941384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:01.956689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211136b0-14a0-4841-9621-9d3ad42093c2 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:02.024033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3083bb-b330-4dbf-83f6-7551fa438b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:02.024725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3083bb-b330-4dbf-83f6-7551fa438b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:02.025009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3083bb-b330-4dbf-83f6-7551fa438b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:02.025349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3083bb-b330-4dbf-83f6-7551fa438b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:02.026094 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3083bb-b330-4dbf-83f6-7551fa438b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:02.027753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3083bb-b330-4dbf-83f6-7551fa438b96 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:02.038653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1149/2311] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:02.043502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:02.055589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80ce6d-a512-4125-bd7e-f9e48ec48fef admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:02.065280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:02.066197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:02.066483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:02.066793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] PATH_INFO: `/v3/projects/abc62176b4d94b7e843b423f7a4d6c60/users/b00057c1a21e47fb89ba725d19671377/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:02.069443 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc62176b4d94b7e843b423f7a4d6c60, user_id=b00057c1a21e47fb89ba725d19671377, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:02.071774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:02.084669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1163/2312] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:02 2022] PUT /identity/v3/projects/abc62176b4d94b7e843b423f7a4d6c60/users/b00057c1a21e47fb89ba725d19671377/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:02.095419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:02.096533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:02.096889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:02.126321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] MFA Rules not processed for user `b00057c1a21e47fb89ba725d19671377`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:02.127677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:02.207029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1150/2313] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:02.219481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:02.221175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:02.282148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee003-bba3-4ade-b122-1f8c624bbff3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:02.285967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366d388-73f9-444c-bb7a-4538944a33b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:02.286651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d388-73f9-444c-bb7a-4538944a33b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:02.286939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d388-73f9-444c-bb7a-4538944a33b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:02.287343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d388-73f9-444c-bb7a-4538944a33b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:02.298231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366d388-73f9-444c-bb7a-4538944a33b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:02.299676 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366d388-73f9-444c-bb7a-4538944a33b9 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:02.309951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1164/2314] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:02.966139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:02.969148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:03.043855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ef19f-9965-4f47-ab74-5b0921c2d867 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:03.048335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:03.049233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:03.049508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:03.049797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] PATH_INFO: `/v3/users/ecad7153f0d44ca9b2e141bcca2062d9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:03.051016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecad7153f0d44ca9b2e141bcca2062d9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:03.053579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:03.319629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecad7153f0d44ca9b2e141bcca2062d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:03.455184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecad7153f0d44ca9b2e141bcca2062d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:03.468860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecad7153f0d44ca9b2e141bcca2062d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:03.469534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecad7153f0d44ca9b2e141bcca2062d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:03.470141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecad7153f0d44ca9b2e141bcca2062d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:03.482933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1151/2315] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:02 2022] DELETE /identity/v3/users/ecad7153f0d44ca9b2e141bcca2062d9 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:03.487241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:03.487695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:03.487811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:03.506400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:03.507786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:03.574064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1165/2316] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:03.584356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:03.586351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:03.656652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:03.658025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:03.664634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e5df7-97f6-4c13-8fe5-0e1a99c0c35f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:03.668528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:03.669185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:03.669471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:03.669751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:03.679106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:03.680849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:03.693149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1152/2317] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:03.720498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191072c-2f68-4dfc-9f61-f8396e62acd5 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:03.724249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:03.724899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:03.725181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:03.725454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:03.727491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:03.791542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:03.792981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:03.802124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1166/2318] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:04.245785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:04.247261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:04.262730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e0e18-f132-4cc1-8a6c-93da4499c902 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:04.270354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:04.271303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:04.271633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:04.271861 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] PATH_INFO: `/v3/projects/fb962ac798774e059b37301b19dcde70` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:04.273963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb962ac798774e059b37301b19dcde70)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:04.276104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:04.463608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb962ac798774e059b37301b19dcde70', 'request_id': 'req-30e52505-8be8-4e2c-ba28-4f5629600dde'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:04.602068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb962ac798774e059b37301b19dcde70', 'request_id': 'req-30e52505-8be8-4e2c-ba28-4f5629600dde'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:04.621579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb962ac798774e059b37301b19dcde70', 'request_id': 'req-30e52505-8be8-4e2c-ba28-4f5629600dde'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:04.635100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] The token cache is being invalidate because project fb962ac798774e059b37301b19dcde70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:04.635506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:04.636329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:04.638192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1153/2319] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:04 2022] DELETE /identity/v3/projects/fb962ac798774e059b37301b19dcde70 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:04.642076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:04.655748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716870b-9df5-4d31-b232-d1d1a38483c1 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:04.710102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:04.711631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:04.711917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:04.712217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] PATH_INFO: `/v3/users/16d28522c8f44584a0435b780ce1a5f9` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:04.713437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d28522c8f44584a0435b780ce1a5f9)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:04.715404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:04.959800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d28522c8f44584a0435b780ce1a5f9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:04.961133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d28522c8f44584a0435b780ce1a5f9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:04.968451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d28522c8f44584a0435b780ce1a5f9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.043363 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d28522c8f44584a0435b780ce1a5f9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.044660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d28522c8f44584a0435b780ce1a5f9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.080347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1167/2320] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:04 2022] DELETE /identity/v3/users/16d28522c8f44584a0435b780ce1a5f9 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:05.645917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:05.647366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:05.668966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e52505-8be8-4e2c-ba28-4f5629600dde admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:05.730807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:05.731695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:05.731972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:05.732244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] PATH_INFO: `/v3/projects/316841b1979241819e9ec5f26e713972` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:05.733419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316841b1979241819e9ec5f26e713972)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:05.735356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:05.865912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316841b1979241819e9ec5f26e713972', 'request_id': 'req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.963031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316841b1979241819e9ec5f26e713972', 'request_id': 'req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.968921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316841b1979241819e9ec5f26e713972', 'request_id': 'req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.980514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] The token cache is being invalidate because project 316841b1979241819e9ec5f26e713972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:05.980808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.981472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:05.983150 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1154/2321] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:05 2022] DELETE /identity/v3/projects/316841b1979241819e9ec5f26e713972 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:05.987607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:05.989810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:06.009957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188d05-81be-487b-b3be-66a172ed1e7a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:06.065231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:06.066112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:06.066395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:06.066731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] PATH_INFO: `/v3/users/2f9f4aca7ef04ddfb0751e05126e64aa` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:06.067924 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9f4aca7ef04ddfb0751e05126e64aa)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:06.070756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:06.292377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9f4aca7ef04ddfb0751e05126e64aa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:06.293049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9f4aca7ef04ddfb0751e05126e64aa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:06.300242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9f4aca7ef04ddfb0751e05126e64aa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:06.386270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9f4aca7ef04ddfb0751e05126e64aa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:06.386979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b51fccf8-23bb-447b-b103-f44163f0ca03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9f4aca7ef04ddfb0751e05126e64aa'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:06.441267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1168/2322] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:05 2022] DELETE /identity/v3/users/2f9f4aca7ef04ddfb0751e05126e64aa => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:06.895953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:06.895953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:06.916102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f174d-ef39-4e4a-b6ea-b8e42d395fd6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:07.023616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:07.024657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.024934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.025213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] PATH_INFO: `/v3/projects/25c96a12b3594a50b9a6cee5e14e0464` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.026442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c96a12b3594a50b9a6cee5e14e0464)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:07.028534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:07.223975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c96a12b3594a50b9a6cee5e14e0464', 'request_id': 'req-0ebd8363-9c3e-4da8-8618-e715febb440c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:07.316486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c96a12b3594a50b9a6cee5e14e0464', 'request_id': 'req-0ebd8363-9c3e-4da8-8618-e715febb440c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:07.324396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c96a12b3594a50b9a6cee5e14e0464', 'request_id': 'req-0ebd8363-9c3e-4da8-8618-e715febb440c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:07.336767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] The token cache is being invalidate because project 25c96a12b3594a50b9a6cee5e14e0464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:07.339604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:07.339604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0ebd8363-9c3e-4da8-8618-e715febb440c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:07.340491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1155/2323] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:06 2022] DELETE /identity/v3/projects/25c96a12b3594a50b9a6cee5e14e0464 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:07.345181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd7be-67a3-42db-8582-cbf06eed4d0a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.346169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd7be-67a3-42db-8582-cbf06eed4d0a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.346444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd7be-67a3-42db-8582-cbf06eed4d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.368816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b39cd7be-67a3-42db-8582-cbf06eed4d0a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:07.370230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b39cd7be-67a3-42db-8582-cbf06eed4d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:07.437000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1169/2324] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:07.445508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418f48-a152-47f4-bcd5-edeca2ee5250 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.445794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418f48-a152-47f4-bcd5-edeca2ee5250 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.446446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418f48-a152-47f4-bcd5-edeca2ee5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.466263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e9418f48-a152-47f4-bcd5-edeca2ee5250 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:07.467485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e9418f48-a152-47f4-bcd5-edeca2ee5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:07.482031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1156/2325] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:07.484956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd7be-67a3-42db-8582-cbf06eed4d0a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:07.495734 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd7be-67a3-42db-8582-cbf06eed4d0a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:07.502551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:07.503280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.503280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.505026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.505026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:17:07.505026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:07.506186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:07.524036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1170/2326] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:17:07.525223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418f48-a152-47f4-bcd5-edeca2ee5250 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:07.535100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418f48-a152-47f4-bcd5-edeca2ee5250 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:07.541106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:07.541915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.542262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.542603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.543398 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:07.545392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:07.754924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1157/2327] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:07 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:07.759361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:07.779680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3716b-d6a0-4e15-8ce3-b30e61be98e6 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:07.784235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:07.785758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:07.854524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:07.855752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.856355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.857450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.858472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:07.860973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:07.896001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43491ae6-b75b-4fe6-8abf-f765618d4c97 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:07.903703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:07.905852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.906133 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.906583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] PATH_INFO: `/v3/users/5e0d13c4a9ff46cfab08c6cfea2f35dd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.909521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0d13c4a9ff46cfab08c6cfea2f35dd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:07.911916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:07.942661 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1171/2328] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:07 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:07.947129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:07.957702 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2906f9-f7b4-479f-a0de-239ea9dd4ffc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:07.963772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:07.964477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:07.964759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:07.981332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:07.981332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:07.981332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:07.981332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1172/2329] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:17:07.985342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:07.998505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74359041-55fb-46c8-b760-4737cf9b3f78 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:08.023475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:08.024144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:08.024423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:08.024692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:08.025424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:08.027071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:08.038772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1173/2330] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:08.043133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:08.057795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610102e8-954d-4da4-b72c-192351924c8f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:08.072597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f4a70-b4c8-4ec8-9fd6-0b1c52ba9d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:08.074148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f4a70-b4c8-4ec8-9fd6-0b1c52ba9d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:08.074664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f4a70-b4c8-4ec8-9fd6-0b1c52ba9d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:08.075169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f4a70-b4c8-4ec8-9fd6-0b1c52ba9d2c admin admin] PATH_INFO: `/v3/projects/4b7b4d8756a44c2fbf560ff42e8f169b/users/8f51691703864964bb7fe388e8eda162/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:08.094522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f4a70-b4c8-4ec8-9fd6-0b1c52ba9d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7b4d8756a44c2fbf560ff42e8f169b, user_id=8f51691703864964bb7fe388e8eda162, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:08.097514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f4a70-b4c8-4ec8-9fd6-0b1c52ba9d2c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:08.121795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0d13c4a9ff46cfab08c6cfea2f35dd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:08.197391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0d13c4a9ff46cfab08c6cfea2f35dd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:08.203873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1174/2331] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:08 2022] PUT /identity/v3/projects/4b7b4d8756a44c2fbf560ff42e8f169b/users/8f51691703864964bb7fe388e8eda162/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:08.211931 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0d13c4a9ff46cfab08c6cfea2f35dd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:08.212652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0d13c4a9ff46cfab08c6cfea2f35dd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:08.213247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-05b881b2-0fc4-40a9-804c-8f93e5b35538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0d13c4a9ff46cfab08c6cfea2f35dd'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:08.216183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:08.216564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:08.216910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:08.226657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1158/2332] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:07 2022] DELETE /identity/v3/users/5e0d13c4a9ff46cfab08c6cfea2f35dd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:08.230940 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:08.231182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:08.231456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:08.254054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:08.255441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:08.258021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] MFA Rules not processed for user `8f51691703864964bb7fe388e8eda162`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:08.259267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:08.321720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1159/2333] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:17:08.332039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:08.333650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:08.341135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1175/2334] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:08.350190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:08.352876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:08.395258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd66962-49d3-453c-8d69-ec2bce355219 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:08.400313 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:08.400965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:08.401246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:08.401520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:08.412202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:08.413901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:08.422140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87183a-7ae5-466f-957a-87bd728c2b5e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:08.424629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1160/2335] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:17:08.428369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66edc3-ea2e-4d47-9ff9-71e1606cabc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bfec7fb739b42bfa2ddd682aa10dc95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:08.429407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66edc3-ea2e-4d47-9ff9-71e1606cabc5 service glance] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:08.429689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66edc3-ea2e-4d47-9ff9-71e1606cabc5 service glance] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:08.429967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66edc3-ea2e-4d47-9ff9-71e1606cabc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:08.439262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66edc3-ea2e-4d47-9ff9-71e1606cabc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:08.440701 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66edc3-ea2e-4d47-9ff9-71e1606cabc5 service glance] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:08.450466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1176/2336] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:08.890908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:08.892332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:08.907757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bfc4d-f157-4427-b229-fe90e2642973 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:08.913939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:08.914867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:08.915151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:08.915953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] PATH_INFO: `/v3/projects/5ff333654b7d41cdb9f8a4101b963ca2` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:08.917122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff333654b7d41cdb9f8a4101b963ca2)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:08.919241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:09.061816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff333654b7d41cdb9f8a4101b963ca2', 'request_id': 'req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:09.149704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff333654b7d41cdb9f8a4101b963ca2', 'request_id': 'req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:09.155687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff333654b7d41cdb9f8a4101b963ca2', 'request_id': 'req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:09.167483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] The token cache is being invalidate because project 5ff333654b7d41cdb9f8a4101b963ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:09.167762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:09.168401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7418aab8-96d0-4f9a-ad0d-5513cab11bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:09.169984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1161/2337] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:08 2022] DELETE /identity/v3/projects/5ff333654b7d41cdb9f8a4101b963ca2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:09.175172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d7436-7464-47f2-9f49-7c2c53a528a0 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.175466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d7436-7464-47f2-9f49-7c2c53a528a0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.175775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d7436-7464-47f2-9f49-7c2c53a528a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.196303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b51d7436-7464-47f2-9f49-7c2c53a528a0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:09.197621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b51d7436-7464-47f2-9f49-7c2c53a528a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:09.255918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1177/2338] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:09.264033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33599-9d52-47ba-9df9-1ef6f6f46aae None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.264319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33599-9d52-47ba-9df9-1ef6f6f46aae None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.264590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33599-9d52-47ba-9df9-1ef6f6f46aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.283652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-3ff33599-9d52-47ba-9df9-1ef6f6f46aae None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:09.284932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3ff33599-9d52-47ba-9df9-1ef6f6f46aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:09.294040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1162/2339] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:09.298255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d7436-7464-47f2-9f49-7c2c53a528a0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:09.308837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d7436-7464-47f2-9f49-7c2c53a528a0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:09.313597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:09.314327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.314715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.315055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.315938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:17:09.316317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:09.317884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:09.330021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1178/2340] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:17:09.335301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33599-9d52-47ba-9df9-1ef6f6f46aae None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:09.344552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33599-9d52-47ba-9df9-1ef6f6f46aae None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:09.349266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:09.349895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.350175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.351028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.351822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:09.353705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:09.485340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1163/2341] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:09 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:09.489605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:09.501256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517486-e8a8-4642-a727-726343fdf6fd admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:09.560464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:09.561172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.561454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.561731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.562484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:09.564422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:09.698133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1179/2342] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:09 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:09.702396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:09.713065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f2619-ecaa-411b-8377-cc72ac0f5755 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:09.717772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:09.718421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.718733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.719009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.719729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:09.721307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:09.732126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1164/2343] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:09.737033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:09.747136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282c35b-734d-4e87-a36d-b8684cc86f34 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:09.751802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e551d-df5c-4212-a5b7-a94a437e273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:09.752452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e551d-df5c-4212-a5b7-a94a437e273f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.752756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e551d-df5c-4212-a5b7-a94a437e273f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.753028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e551d-df5c-4212-a5b7-a94a437e273f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.753757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e551d-df5c-4212-a5b7-a94a437e273f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:09.755366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e551d-df5c-4212-a5b7-a94a437e273f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:09.765951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1180/2344] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:09.769933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:09.780351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5383a-2605-4e6b-81d6-fbb0b1efd7a1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:09.784913 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:09.785791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.786071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.786347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] PATH_INFO: `/v3/projects/c271c9fbccdc440a9093f671ea81b71f/users/744b3f01cc8f4c87a1fc978138324329/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.801967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c271c9fbccdc440a9093f671ea81b71f, user_id=744b3f01cc8f4c87a1fc978138324329, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:09.804632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:09.927185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1165/2345] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:09 2022] PUT /identity/v3/projects/c271c9fbccdc440a9093f671ea81b71f/users/744b3f01cc8f4c87a1fc978138324329/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:09.938747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b485-de72-4d8b-af9d-d60442c6f3c2 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:09.939036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b485-de72-4d8b-af9d-d60442c6f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:09.939310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b485-de72-4d8b-af9d-d60442c6f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:09.977113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-88a0b485-de72-4d8b-af9d-d60442c6f3c2 None None] MFA Rules not processed for user `744b3f01cc8f4c87a1fc978138324329`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:09.978406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-88a0b485-de72-4d8b-af9d-d60442c6f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:10.050068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1181/2346] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:10.054647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:10.665436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56101a-774f-4e45-880d-93d1f99225dd admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:10.665436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:10.665436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:10.665436 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:10.668336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:10.668336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:10.668336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:10.707667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1166/2347] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:10 2022] POST /identity/v3/projects => generated 383 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:10.712142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b485-de72-4d8b-af9d-d60442c6f3c2 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:10.723689 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b485-de72-4d8b-af9d-d60442c6f3c2 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:10.781977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:10.782679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:10.782959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:10.783231 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:10.783984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:10.785902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:10.896357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1182/2348] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:10 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:17:10.898263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:10.909592 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110fd4c-14d7-4816-a34b-fcf8a7d53f6c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:10.916740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:10.916740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:10.916740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:10.916740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:10.917315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:10.918867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:10.930086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1167/2349] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:10.933985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:10.946102 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7eed-afec-431e-9b72-0c9f8e6ee7f2 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:10.951309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549d152-73a9-41e1-a3c6-d7c10ffec6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:10.959051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549d152-73a9-41e1-a3c6-d7c10ffec6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:10.959051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549d152-73a9-41e1-a3c6-d7c10ffec6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:10.959051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549d152-73a9-41e1-a3c6-d7c10ffec6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:10.959051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549d152-73a9-41e1-a3c6-d7c10ffec6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:10.959051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549d152-73a9-41e1-a3c6-d7c10ffec6c6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:10.966328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1183/2350] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:10.970725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:10.981671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26edc30-bedf-4e40-8e8b-cf6eb9660a70 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:10.986535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:10.987454 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:10.987738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:10.988014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] PATH_INFO: `/v3/projects/7bdf104892b246158a3e5c4a927fe9b3/users/ae4463b65ed54b83b97ea94943b7318e/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.003675 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bdf104892b246158a3e5c4a927fe9b3, user_id=ae4463b65ed54b83b97ea94943b7318e, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:11.006307 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:11.117248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1168/2351] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:10 2022] PUT /identity/v3/projects/7bdf104892b246158a3e5c4a927fe9b3/users/ae4463b65ed54b83b97ea94943b7318e/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:11.130343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a76d-9249-4315-a81a-445ebec2ba8e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.130660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a76d-9249-4315-a81a-445ebec2ba8e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.130942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a76d-9249-4315-a81a-445ebec2ba8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.157990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1dd7a76d-9249-4315-a81a-445ebec2ba8e None None] MFA Rules not processed for user `ae4463b65ed54b83b97ea94943b7318e`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:11.159246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1dd7a76d-9249-4315-a81a-445ebec2ba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:11.221229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1184/2352] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:11.226391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:11.290409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b176c7-3953-4505-a50e-2f84d2eea958 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:11.299399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:11.299399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.299399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.299399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.299767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:11.299767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:11.433401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1169/2353] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:11 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:11.437874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a76d-9249-4315-a81a-445ebec2ba8e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:11.449786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a76d-9249-4315-a81a-445ebec2ba8e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:11.527294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:11.527294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.527536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.527705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.528413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:11.530356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:11.627116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1185/2354] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:11 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:11.634837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:11.645421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334a92-0d6e-4f33-b50e-37245b258a2e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:11.650864 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:11.651536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.651813 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.652099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.652844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:11.654419 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:11.665520 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1170/2355] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:11.669613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:11.682234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79d483-a9fd-4bd0-a2e8-ef406db55041 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:11.687419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:11.688336 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.688615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.688889 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] PATH_INFO: `/v3/projects/ac13e959e9864f22ac3b2e8006d29ee5/users/9d6a7f73079f4c29b29e443ff3284c27/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.704238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac13e959e9864f22ac3b2e8006d29ee5, user_id=9d6a7f73079f4c29b29e443ff3284c27, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:11.707059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:11.848752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1186/2356] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:11 2022] PUT /identity/v3/projects/ac13e959e9864f22ac3b2e8006d29ee5/users/9d6a7f73079f4c29b29e443ff3284c27/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:11.853546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:11.868091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c19b-7f9f-442b-867a-fd0dc3a7cd1e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:11.929387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a733e-2366-4d4e-ace1-e32e8e5c1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:11.930079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a733e-2366-4d4e-ace1-e32e8e5c1eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.930365 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a733e-2366-4d4e-ace1-e32e8e5c1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.930953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a733e-2366-4d4e-ace1-e32e8e5c1eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.931420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a733e-2366-4d4e-ace1-e32e8e5c1eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:11.933442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a733e-2366-4d4e-ace1-e32e8e5c1eb0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:11.944370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1171/2357] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:17:11.948771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:11.959177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616533-aa1c-43ec-bfb6-30b85a1b47a6 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:11.965031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:11.965970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.966253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.966530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] PATH_INFO: `/v3/projects/ac13e959e9864f22ac3b2e8006d29ee5/users/9d6a7f73079f4c29b29e443ff3284c27/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:11.968525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac13e959e9864f22ac3b2e8006d29ee5, user_id=9d6a7f73079f4c29b29e443ff3284c27, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:11.971372 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:11.983298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1187/2358] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:11 2022] PUT /identity/v3/projects/ac13e959e9864f22ac3b2e8006d29ee5/users/9d6a7f73079f4c29b29e443ff3284c27/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:11.994102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:11.994400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:11.994748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:12.023810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] MFA Rules not processed for user `9d6a7f73079f4c29b29e443ff3284c27`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:12.025025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:12.101231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1172/2359] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:12.112426 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:12.114059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:12.170698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4e493-2cb9-47f9-b29a-ed17ecfbf511 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:12.174264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172286c4-eb0d-4ab5-928d-f5ff64ba4e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:12.174940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172286c4-eb0d-4ab5-928d-f5ff64ba4e61 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:12.175219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172286c4-eb0d-4ab5-928d-f5ff64ba4e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:12.175490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172286c4-eb0d-4ab5-928d-f5ff64ba4e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:12.229207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172286c4-eb0d-4ab5-928d-f5ff64ba4e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:12.230655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172286c4-eb0d-4ab5-928d-f5ff64ba4e61 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:12.239325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1188/2360] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:13.530488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:13.532593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:13.546670 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e25921-6a75-47a8-bf68-335dd133ee62 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:13.550889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:13.551577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:13.551860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:13.552143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:13.554167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:13.621596 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:13.623128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:13.632644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1173/2361] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:22.062672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0f62-fdf9-4375-a30d-f4abbdb2bbfe None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:22.062672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0f62-fdf9-4375-a30d-f4abbdb2bbfe None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:22.062672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0f62-fdf9-4375-a30d-f4abbdb2bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:22.112716 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-cd4d0f62-fdf9-4375-a30d-f4abbdb2bbfe None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:22.113949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-cd4d0f62-fdf9-4375-a30d-f4abbdb2bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:22.186339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1189/2362] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:17:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:22.367531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:22.368956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:22.462998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8115e2-8abc-40a3-b4bc-2c586a4359e9 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:22.468469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:22.469118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:22.469401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:22.469677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:22.479296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:22.484833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:22.489762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1174/2363] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:17:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:17:22.736445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0f62-fdf9-4375-a30d-f4abbdb2bbfe None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:22.747985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0f62-fdf9-4375-a30d-f4abbdb2bbfe None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:22.752600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:22.753283 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:22.753592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:22.753832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:22.822573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:22.825384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:22.843153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1190/2364] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:17:24.692332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:24.700690 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041220-0e8f-4e15-bea6-d7fa45f73155 service swift] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:24.704402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cec3e-5d63-438d-bc3f-bd35800cc50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:24.705050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cec3e-5d63-438d-bc3f-bd35800cc50e service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:24.705527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cec3e-5d63-438d-bc3f-bd35800cc50e service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:24.705801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cec3e-5d63-438d-bc3f-bd35800cc50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:24.716625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cec3e-5d63-438d-bc3f-bd35800cc50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:24.718068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cec3e-5d63-438d-bc3f-bd35800cc50e service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:24.728604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1175/2365] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:24.809020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:24.810524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:24.894564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496340e-b936-4a94-8db0-4b304386c8c6 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:24.900664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:24.901821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:24.902204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:24.902678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] PATH_INFO: `/v3/users/68fe23e841ac45bbb5b5939c9b6faaad` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:24.904007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fe23e841ac45bbb5b5939c9b6faaad)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:24.906182 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:25.139996 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fe23e841ac45bbb5b5939c9b6faaad'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:25.140692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fe23e841ac45bbb5b5939c9b6faaad'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:25.147938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fe23e841ac45bbb5b5939c9b6faaad'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:25.245480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fe23e841ac45bbb5b5939c9b6faaad'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:25.246120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fe23e841ac45bbb5b5939c9b6faaad'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:25.266583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1191/2366] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:24 2022] DELETE /identity/v3/users/68fe23e841ac45bbb5b5939c9b6faaad => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:25.272180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:25.272494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:25.272778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:25.291517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:25.292714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:25.362978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1176/2367] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:17:25.372334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:25.374572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:25.438274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df241f6a-b82d-4e94-adcd-f1ec3464a7ae admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:25.441819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:25.442535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:25.449242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:25.449242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:25.452251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:25.453775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:25.464356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1192/2368] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:26.061195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:26.063018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:26.076774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a259c-4ca8-4aed-beed-047d653069dc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:26.081703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:26.084105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:26.084413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:26.084757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] PATH_INFO: `/v3/projects/22c262e17efb4fa79613411d8c09724c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:26.086480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c262e17efb4fa79613411d8c09724c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:26.099427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:26.260269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c262e17efb4fa79613411d8c09724c', 'request_id': 'req-5ea90037-c81b-4d48-a063-751d6e24f3cb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.377038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c262e17efb4fa79613411d8c09724c', 'request_id': 'req-5ea90037-c81b-4d48-a063-751d6e24f3cb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.383435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c262e17efb4fa79613411d8c09724c', 'request_id': 'req-5ea90037-c81b-4d48-a063-751d6e24f3cb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.403710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] The token cache is being invalidate because project 22c262e17efb4fa79613411d8c09724c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:26.404380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.405195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.408050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1177/2369] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:26 2022] DELETE /identity/v3/projects/22c262e17efb4fa79613411d8c09724c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:26.413319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:26.428786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2bb7a-0238-4a8f-8588-8c7497a1d276 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:26.495430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:26.496330 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:26.496761 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:26.497067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] PATH_INFO: `/v3/users/407f61648810400ba5b376bcdd9a1a0d` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:26.498296 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407f61648810400ba5b376bcdd9a1a0d)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:26.500282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:26.757321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407f61648810400ba5b376bcdd9a1a0d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.757981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407f61648810400ba5b376bcdd9a1a0d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.765559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407f61648810400ba5b376bcdd9a1a0d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.863924 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407f61648810400ba5b376bcdd9a1a0d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.868405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407f61648810400ba5b376bcdd9a1a0d'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:26.886985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1193/2370] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:26 2022] DELETE /identity/v3/users/407f61648810400ba5b376bcdd9a1a0d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:27.454720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:27.458796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:27.477049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90037-c81b-4d48-a063-751d6e24f3cb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:27.551204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:27.553298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:27.553822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:27.554459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] PATH_INFO: `/v3/projects/b6685451cfc14721abd5922a3cae6fae` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:27.556446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6685451cfc14721abd5922a3cae6fae)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:27.558705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:27.687134 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6685451cfc14721abd5922a3cae6fae', 'request_id': 'req-f547346d-59b1-4ec4-b00c-541037642363'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:27.766835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6685451cfc14721abd5922a3cae6fae', 'request_id': 'req-f547346d-59b1-4ec4-b00c-541037642363'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:27.774715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6685451cfc14721abd5922a3cae6fae', 'request_id': 'req-f547346d-59b1-4ec4-b00c-541037642363'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:27.789882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] The token cache is being invalidate because project b6685451cfc14721abd5922a3cae6fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:27.790188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:27.790972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:27.792858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1178/2371] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:27 2022] DELETE /identity/v3/projects/b6685451cfc14721abd5922a3cae6fae => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:27.796572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:27.798956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:27.819841 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea391-8220-42fe-b29b-453f52f40e85 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:27.882302 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:27.883378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:27.883660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:27.883932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] PATH_INFO: `/v3/users/b00057c1a21e47fb89ba725d19671377` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:27.885294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00057c1a21e47fb89ba725d19671377)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:27.887760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:28.124199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00057c1a21e47fb89ba725d19671377'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:28.124877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00057c1a21e47fb89ba725d19671377'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:28.131791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00057c1a21e47fb89ba725d19671377'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:28.260471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00057c1a21e47fb89ba725d19671377'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:28.260471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec166099-edb6-43e1-a3f9-3f6837bb9daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00057c1a21e47fb89ba725d19671377'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:28.279148 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1194/2372] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:27 2022] DELETE /identity/v3/users/b00057c1a21e47fb89ba725d19671377 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:28.836324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:28.837828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:28.863197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547346d-59b1-4ec4-b00c-541037642363 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:28.968998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:28.969896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:28.970306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:28.970818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] PATH_INFO: `/v3/projects/abc62176b4d94b7e843b423f7a4d6c60` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:28.972317 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc62176b4d94b7e843b423f7a4d6c60)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:28.975546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:29.147574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc62176b4d94b7e843b423f7a4d6c60', 'request_id': 'req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:29.240845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc62176b4d94b7e843b423f7a4d6c60', 'request_id': 'req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:29.248616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc62176b4d94b7e843b423f7a4d6c60', 'request_id': 'req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:29.262043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] The token cache is being invalidate because project abc62176b4d94b7e843b423f7a4d6c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:29.262428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:29.265606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-a3d2ad4d-c593-4cc5-aa69-c4cb0b8ba9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:29.265606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1179/2373] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:28 2022] DELETE /identity/v3/projects/abc62176b4d94b7e843b423f7a4d6c60 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:29.272802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787997-45ea-4459-b006-0e1c545870bd None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.273694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787997-45ea-4459-b006-0e1c545870bd None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.273986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787997-45ea-4459-b006-0e1c545870bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.296425 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b3787997-45ea-4459-b006-0e1c545870bd None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:29.299681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b3787997-45ea-4459-b006-0e1c545870bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:29.362849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1195/2374] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:29.373205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4928ac-1142-41ac-8da9-2bc759003271 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.380710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4928ac-1142-41ac-8da9-2bc759003271 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.380710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4928ac-1142-41ac-8da9-2bc759003271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.394336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4a4928ac-1142-41ac-8da9-2bc759003271 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:29.395694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4a4928ac-1142-41ac-8da9-2bc759003271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:29.404473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1180/2375] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:29.408644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3787997-45ea-4459-b006-0e1c545870bd None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:29.419516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3787997-45ea-4459-b006-0e1c545870bd None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:29.424220 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:29.424879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.425159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.425614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.427060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:17:29.427393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:29.429076 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:29.440902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1196/2376] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:17:29.454564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4928ac-1142-41ac-8da9-2bc759003271 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:29.455103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4928ac-1142-41ac-8da9-2bc759003271 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:29.459869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:29.460615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.460859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.461161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.461901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:29.463950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:29.568922 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1181/2377] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:29 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:17:29.575760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:29.587209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65e4d6-04e9-4113-b13e-c458b891002f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:29.656039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:29.657089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.657383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.657742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.658592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:29.662062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:29.781123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1197/2378] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:29 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:17:29.781404 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:29.793444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cfc60-93cf-4c51-a483-718b975318d8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:29.799587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:29.800659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.801066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.801760 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.802718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:29.804741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:29.839493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1182/2379] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:29.843307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:29.860066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4afe93-91ce-48cb-8550-128f44a86413 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:29.868332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9e779-f82a-4914-9750-f3641b9778c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:29.869185 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9e779-f82a-4914-9750-f3641b9778c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.869472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9e779-f82a-4914-9750-f3641b9778c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.869773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9e779-f82a-4914-9750-f3641b9778c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.870486 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9e779-f82a-4914-9750-f3641b9778c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:29.872329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9e779-f82a-4914-9750-f3641b9778c1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:29.885863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1198/2380] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:29.889907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:29.901893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba005e6-3b82-4004-9d23-a20bccebcc1d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:29.907075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:29.908012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:29.908293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:29.908566 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] PATH_INFO: `/v3/projects/56653d3bcb334731874dd7dfb3c6ca94/users/4d818c57a73649cf9e369dd45e6b7781/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:29.929060 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56653d3bcb334731874dd7dfb3c6ca94, user_id=4d818c57a73649cf9e369dd45e6b7781, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:29.931994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.041775 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1183/2381] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:29 2022] PUT /identity/v3/projects/56653d3bcb334731874dd7dfb3c6ca94/users/4d818c57a73649cf9e369dd45e6b7781/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:30.054670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108d8b7-2a29-4a4b-bc5b-61eb68643730 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.054966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108d8b7-2a29-4a4b-bc5b-61eb68643730 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.055364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108d8b7-2a29-4a4b-bc5b-61eb68643730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.094536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2108d8b7-2a29-4a4b-bc5b-61eb68643730 None None] MFA Rules not processed for user `4d818c57a73649cf9e369dd45e6b7781`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:30.095846 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2108d8b7-2a29-4a4b-bc5b-61eb68643730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:30.172539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1199/2382] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:30.177882 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:30.258179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a074d-efd3-4fbb-8479-3cc27db0502d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:30.264705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:30.265681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.265943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.266223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.267375 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:30.269826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.399348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1184/2383] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:30 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:30.404457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108d8b7-2a29-4a4b-bc5b-61eb68643730 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:30.420992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108d8b7-2a29-4a4b-bc5b-61eb68643730 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:30.483571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:30.484416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.484705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.484979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.485853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:30.487803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.603828 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1200/2384] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:30 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:30.607859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:30.623157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03dc9-7999-45bb-8462-afb633180168 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:30.629305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:30.630966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.631701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.631827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.633036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:30.635531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.648701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1185/2385] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:17:30.654243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:30.665447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d67cd-e78e-48fd-8f66-c590898e9143 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:30.670542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:30.671491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.671785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.672121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] PATH_INFO: `/v3/projects/9a9eaa27701d4d4085cb2b0dd22c2e1a/users/eeef068f3d014bf3a0533da9c005416f/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.688636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9eaa27701d4d4085cb2b0dd22c2e1a, user_id=eeef068f3d014bf3a0533da9c005416f, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:30.691685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.795158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1201/2386] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:30 2022] PUT /identity/v3/projects/9a9eaa27701d4d4085cb2b0dd22c2e1a/users/eeef068f3d014bf3a0533da9c005416f/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:30.799135 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:30.811489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91c43c-9aca-4857-b7d8-d3a53426b0df admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:30.880784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:30.888069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.888069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.888069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.888069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:30.888069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.898770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1186/2387] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:30.902735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:30.913979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:30.915525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d545dca-bf07-4677-a78e-46d4b635341a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:30.915674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:30.920122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f9d1-c96b-48cf-8f46-75b332d734a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:30.921001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f9d1-c96b-48cf-8f46-75b332d734a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.921279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f9d1-c96b-48cf-8f46-75b332d734a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.921551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f9d1-c96b-48cf-8f46-75b332d734a1 admin admin] PATH_INFO: `/v3/projects/9a9eaa27701d4d4085cb2b0dd22c2e1a/users/eeef068f3d014bf3a0533da9c005416f/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.923531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f9d1-c96b-48cf-8f46-75b332d734a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9eaa27701d4d4085cb2b0dd22c2e1a, user_id=eeef068f3d014bf3a0533da9c005416f, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:30.926131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f9d1-c96b-48cf-8f46-75b332d734a1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.928687 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705e3e2-6860-488c-9898-4fdf9109c71f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:30.939138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:30.939968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.940386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.940535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] PATH_INFO: `/v3/users/744b3f01cc8f4c87a1fc978138324329` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.941436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1202/2388] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:30 2022] PUT /identity/v3/projects/9a9eaa27701d4d4085cb2b0dd22c2e1a/users/eeef068f3d014bf3a0533da9c005416f/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:30.942141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744b3f01cc8f4c87a1fc978138324329)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:30.944213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:30.953061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:30.953343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:30.953647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:30.981793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] MFA Rules not processed for user `eeef068f3d014bf3a0533da9c005416f`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:30.983049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:31.050538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1203/2389] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:17:31.063849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:31.065362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:31.122736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f6eff-e8e5-4c4e-9a8f-1633cb7de5e6 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:31.128033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd3fd6-8366-40b7-adab-7bf586a90cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:31.128691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3fd6-8366-40b7-adab-7bf586a90cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:31.128969 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3fd6-8366-40b7-adab-7bf586a90cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:31.129272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3fd6-8366-40b7-adab-7bf586a90cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:31.139428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd3fd6-8366-40b7-adab-7bf586a90cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:31.140909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744b3f01cc8f4c87a1fc978138324329'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:31.142597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd3fd6-8366-40b7-adab-7bf586a90cd4 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:31.152299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1204/2390] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:17:31.210657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744b3f01cc8f4c87a1fc978138324329'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:31.224023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744b3f01cc8f4c87a1fc978138324329'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:31.224759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744b3f01cc8f4c87a1fc978138324329'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:31.225510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744b3f01cc8f4c87a1fc978138324329'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:31.246346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1187/2391] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:30 2022] DELETE /identity/v3/users/744b3f01cc8f4c87a1fc978138324329 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:17:31.247872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:31.248203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:31.248487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:31.284241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:31.286241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:31.355044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1205/2392] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:31.366556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:31.368113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:31.383027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:31.387904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:31.435730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00d839-f71c-4476-bcf7-d68c7c5195f0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:31.440491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:31.441278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:31.441573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:31.442046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:31.452784 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:31.453417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:31.456591 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950d609-38d5-43da-b4d1-d72fa99103cc None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:31.461713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:31.462466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:31.462890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:31.463233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:31.465878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:31.468820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1188/2393] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:31.542440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:31.544631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:31.563163 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1206/2394] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:31.951759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:31.953992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:31.969902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eb396-fc2a-4b07-ab6c-fc5cc608fad2 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:31.975129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:31.976118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:31.976519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:31.976863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] PATH_INFO: `/v3/projects/c271c9fbccdc440a9093f671ea81b71f` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:31.979598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c271c9fbccdc440a9093f671ea81b71f)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:31.986088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:32.160227 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c271c9fbccdc440a9093f671ea81b71f', 'request_id': 'req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.262549 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c271c9fbccdc440a9093f671ea81b71f', 'request_id': 'req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.269518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c271c9fbccdc440a9093f671ea81b71f', 'request_id': 'req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.286477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] The token cache is being invalidate because project c271c9fbccdc440a9093f671ea81b71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:32.287054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.287554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.289400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1189/2395] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:31 2022] DELETE /identity/v3/projects/c271c9fbccdc440a9093f671ea81b71f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:32.293816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:32.307784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940e80-312d-4b38-af0e-c550788cc49d service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:32.374914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:32.384065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:32.384065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:32.384065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] PATH_INFO: `/v3/users/ae4463b65ed54b83b97ea94943b7318e` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:32.384065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4463b65ed54b83b97ea94943b7318e)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:32.384065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:32.674327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4463b65ed54b83b97ea94943b7318e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.677049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4463b65ed54b83b97ea94943b7318e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.683304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4463b65ed54b83b97ea94943b7318e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.783399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4463b65ed54b83b97ea94943b7318e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.783885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4463b65ed54b83b97ea94943b7318e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:32.804002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1207/2396] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:32 2022] DELETE /identity/v3/users/ae4463b65ed54b83b97ea94943b7318e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:33.253621 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:33.266950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:33.270399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8397-7453-46a7-b0d9-8bc2e3603d9b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:33.341589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:33.342705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:33.343092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:33.343440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] PATH_INFO: `/v3/projects/7bdf104892b246158a3e5c4a927fe9b3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:33.345441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bdf104892b246158a3e5c4a927fe9b3)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:33.347871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:33.489143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdf104892b246158a3e5c4a927fe9b3', 'request_id': 'req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:33.560395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdf104892b246158a3e5c4a927fe9b3', 'request_id': 'req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:33.567663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdf104892b246158a3e5c4a927fe9b3', 'request_id': 'req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:33.579084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] The token cache is being invalidate because project 7bdf104892b246158a3e5c4a927fe9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:33.579360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:33.580011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:33.581588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1190/2397] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:33 2022] DELETE /identity/v3/projects/7bdf104892b246158a3e5c4a927fe9b3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:33.585752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:33.587298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:33.601849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba552a-81cb-4db5-abed-09b50c35eed3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:33.665293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:33.666207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:33.666501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:33.666865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] PATH_INFO: `/v3/users/9d6a7f73079f4c29b29e443ff3284c27` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:33.668043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6a7f73079f4c29b29e443ff3284c27)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:33.669954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:33.957831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6a7f73079f4c29b29e443ff3284c27'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:33.958558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6a7f73079f4c29b29e443ff3284c27'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:33.985850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6a7f73079f4c29b29e443ff3284c27'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.154023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6a7f73079f4c29b29e443ff3284c27'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.154702 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9fad8b23-8a40-4804-b980-50c78ced9b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6a7f73079f4c29b29e443ff3284c27'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.183805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1208/2398] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:33 2022] DELETE /identity/v3/users/9d6a7f73079f4c29b29e443ff3284c27 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:34.624443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:34.625870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:34.640023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad19cd-dc44-4358-a1d1-7d3a1b2b9f25 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:34.703032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:34.703897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:34.704205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:34.704480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] PATH_INFO: `/v3/projects/ac13e959e9864f22ac3b2e8006d29ee5` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:34.705659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac13e959e9864f22ac3b2e8006d29ee5)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:34.707759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:34.869439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac13e959e9864f22ac3b2e8006d29ee5', 'request_id': 'req-06a9205d-0b15-495d-96b4-97cf3674c422'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.954901 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac13e959e9864f22ac3b2e8006d29ee5', 'request_id': 'req-06a9205d-0b15-495d-96b4-97cf3674c422'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.961416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac13e959e9864f22ac3b2e8006d29ee5', 'request_id': 'req-06a9205d-0b15-495d-96b4-97cf3674c422'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.974312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] The token cache is being invalidate because project ac13e959e9864f22ac3b2e8006d29ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:34.974599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.975300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-06a9205d-0b15-495d-96b4-97cf3674c422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:34.976820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1191/2399] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:34 2022] DELETE /identity/v3/projects/ac13e959e9864f22ac3b2e8006d29ee5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:34.981678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e5a3-dae9-4484-913f-234c4a63c328 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:34.982180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e5a3-dae9-4484-913f-234c4a63c328 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:34.982311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e5a3-dae9-4484-913f-234c4a63c328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.001694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c9a7e5a3-dae9-4484-913f-234c4a63c328 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:35.002925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c9a7e5a3-dae9-4484-913f-234c4a63c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:35.064335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1209/2400] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:35.072736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b97953-33e2-41b3-a433-6e78a2561c4e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.072944 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b97953-33e2-41b3-a433-6e78a2561c4e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.073218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b97953-33e2-41b3-a433-6e78a2561c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.096046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d3b97953-33e2-41b3-a433-6e78a2561c4e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:35.097272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d3b97953-33e2-41b3-a433-6e78a2561c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:35.108366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1192/2401] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:35.113133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e5a3-dae9-4484-913f-234c4a63c328 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:35.122914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e5a3-dae9-4484-913f-234c4a63c328 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:35.127543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:35.128258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.128626 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.128965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.129881 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:17:35.130165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:35.137404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:35.143729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1210/2402] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:17:35.148232 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b97953-33e2-41b3-a433-6e78a2561c4e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:35.157252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b97953-33e2-41b3-a433-6e78a2561c4e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:35.162132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:35.162830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.163114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.163391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.164082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:35.165997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:35.252807 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1193/2403] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:35 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:35.261510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:35.272227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838285b8-8cfb-4b72-8f41-b0b1726b6157 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:35.325646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:35.326222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.326503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.326807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.327508 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:35.329409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:35.433954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1211/2404] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:35 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:35.437954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:35.448597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffa46-3090-4027-b043-f8add5c2d3c0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:35.453535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:35.454204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.454486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.454788 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.455548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:35.457820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:35.468115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1194/2405] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:35.472170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:35.482561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41839b9c-ee26-4ed9-a43d-a749f9b948f2 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:35.487221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47d48-d318-44c1-be1e-9795c74fcdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:35.487876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47d48-d318-44c1-be1e-9795c74fcdbc admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.488217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47d48-d318-44c1-be1e-9795c74fcdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.488511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47d48-d318-44c1-be1e-9795c74fcdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.489236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a47d48-d318-44c1-be1e-9795c74fcdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:35.490875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a47d48-d318-44c1-be1e-9795c74fcdbc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:35.500686 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1212/2406] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:35.505479 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:35.515332 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240f22-848a-489a-9f1e-4ead4404176c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:35.520957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:35.521846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.522113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.522386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] PATH_INFO: `/v3/projects/8a6ed0b44244485885a92dc64f293bba/users/88f265ced0f040c8b5c841ea0b6db513/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.536503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6ed0b44244485885a92dc64f293bba, user_id=88f265ced0f040c8b5c841ea0b6db513, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:35.539183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:35.645412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1195/2407] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:35 2022] PUT /identity/v3/projects/8a6ed0b44244485885a92dc64f293bba/users/88f265ced0f040c8b5c841ea0b6db513/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:35.655739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.656030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.656309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.683352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] MFA Rules not processed for user `88f265ced0f040c8b5c841ea0b6db513`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:35.684599 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:35.746567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1213/2408] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:35.758597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:35.760283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:35.819799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d5bb3-485e-46e2-9fb6-f339004d0189 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:35.823476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593398-f5db-4671-a3c2-1ff0e4386e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:35.824110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593398-f5db-4671-a3c2-1ff0e4386e14 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:35.824388 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593398-f5db-4671-a3c2-1ff0e4386e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:35.824656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593398-f5db-4671-a3c2-1ff0e4386e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:35.837277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69593398-f5db-4671-a3c2-1ff0e4386e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:35.842563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69593398-f5db-4671-a3c2-1ff0e4386e14 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:35.855083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1196/2409] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:45.208431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:45.209860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:45.283717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589fc85-9d70-4f62-bf99-f357e836fd84 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:45.289370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:45.290297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:45.290642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:45.290950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] PATH_INFO: `/v3/users/4d818c57a73649cf9e369dd45e6b7781` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:45.292294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d818c57a73649cf9e369dd45e6b7781)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:45.295140 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:45.516444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d818c57a73649cf9e369dd45e6b7781'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:45.518113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d818c57a73649cf9e369dd45e6b7781'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:45.526713 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d818c57a73649cf9e369dd45e6b7781'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:45.610381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d818c57a73649cf9e369dd45e6b7781'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:45.611225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d818c57a73649cf9e369dd45e6b7781'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:45.634229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1214/2410] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:45 2022] DELETE /identity/v3/users/4d818c57a73649cf9e369dd45e6b7781 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:45.639502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:45.640105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:45.640105 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:45.663981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:45.665188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:45.754832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1197/2411] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:45.763413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:45.765911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:45.839791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20636c3-3745-4163-a25e-3cf5e2d9532a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:45.844092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:45.844895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:45.845275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:45.845652 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:45.857355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:45.858848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:45.870270 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1215/2412] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:46.293980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:46.296382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:46.323716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e7067-a576-41a3-8dc0-13ff0d8e409a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:46.329813 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:46.330741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:46.330926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:46.331180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] PATH_INFO: `/v3/projects/56653d3bcb334731874dd7dfb3c6ca94` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:46.333414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56653d3bcb334731874dd7dfb3c6ca94)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:46.335752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:46.456466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56653d3bcb334731874dd7dfb3c6ca94', 'request_id': 'req-78ffc7aa-ace9-4388-9bde-9c824441e269'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.530816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56653d3bcb334731874dd7dfb3c6ca94', 'request_id': 'req-78ffc7aa-ace9-4388-9bde-9c824441e269'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.538460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56653d3bcb334731874dd7dfb3c6ca94', 'request_id': 'req-78ffc7aa-ace9-4388-9bde-9c824441e269'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.551121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] The token cache is being invalidate because project 56653d3bcb334731874dd7dfb3c6ca94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:46.551416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.552127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.553969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1198/2413] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:46 2022] DELETE /identity/v3/projects/56653d3bcb334731874dd7dfb3c6ca94 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:46.557914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:46.569029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46e380-e45a-47a4-96bb-5050b1889103 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:46.642709 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:46.643672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:46.643988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:46.644242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] PATH_INFO: `/v3/users/eeef068f3d014bf3a0533da9c005416f` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:46.645588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeef068f3d014bf3a0533da9c005416f)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:46.647855 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:46.849275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeef068f3d014bf3a0533da9c005416f'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.851094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeef068f3d014bf3a0533da9c005416f'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.873055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeef068f3d014bf3a0533da9c005416f'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.916161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:46.917707 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:46.943671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffc7aa-ace9-4388-9bde-9c824441e269 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:46.951975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:46.956935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:46.956935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:46.956935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] PATH_INFO: `/v3/users/e5a889d1e32d46b88cc162e23e05f770` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:46.957297 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeef068f3d014bf3a0533da9c005416f'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.957389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a889d1e32d46b88cc162e23e05f770)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:46.957475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-9c3d6a53-dc89-4643-93ab-1d8d266d4092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeef068f3d014bf3a0533da9c005416f'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:46.979087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:47.023481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1216/2414] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:46 2022] DELETE /identity/v3/users/eeef068f3d014bf3a0533da9c005416f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:47.239611 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a889d1e32d46b88cc162e23e05f770'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.348562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a889d1e32d46b88cc162e23e05f770'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.364137 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a889d1e32d46b88cc162e23e05f770'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.365022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a889d1e32d46b88cc162e23e05f770'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.365679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a889d1e32d46b88cc162e23e05f770'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.390223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1199/2415] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:46 2022] DELETE /identity/v3/users/e5a889d1e32d46b88cc162e23e05f770 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:47.392275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:47.392589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:47.392872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:47.418390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:47.419627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:47.520012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1217/2416] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:17:47.531481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:47.534705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:47.561165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:47.566110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:47.603586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e2b5-2756-48f4-a020-271d96ecf6c5 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:47.608401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:47.609710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:47.610436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:47.610981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] PATH_INFO: `/v3/projects/9a9eaa27701d4d4085cb2b0dd22c2e1a` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:47.613208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9eaa27701d4d4085cb2b0dd22c2e1a)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:47.616932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:47.661205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0ecc-a9f4-45a1-bb76-d63177bdafdd admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:47.670252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33590630-7a5a-4a14-aae4-157e416b9ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:47.670692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33590630-7a5a-4a14-aae4-157e416b9ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:47.671245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33590630-7a5a-4a14-aae4-157e416b9ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:47.671554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33590630-7a5a-4a14-aae4-157e416b9ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:47.683898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33590630-7a5a-4a14-aae4-157e416b9ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:47.685638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33590630-7a5a-4a14-aae4-157e416b9ff9 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:47.701001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1200/2417] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:47.790088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9eaa27701d4d4085cb2b0dd22c2e1a', 'request_id': 'req-a0af0478-36ee-4b47-804a-8ee0a6abde16'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.796556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9eaa27701d4d4085cb2b0dd22c2e1a', 'request_id': 'req-a0af0478-36ee-4b47-804a-8ee0a6abde16'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.863583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9eaa27701d4d4085cb2b0dd22c2e1a', 'request_id': 'req-a0af0478-36ee-4b47-804a-8ee0a6abde16'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.879074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] The token cache is being invalidate because project 9a9eaa27701d4d4085cb2b0dd22c2e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:47.880444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.881431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a0af0478-36ee-4b47-804a-8ee0a6abde16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:47.883853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1218/2418] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:47 2022] DELETE /identity/v3/projects/9a9eaa27701d4d4085cb2b0dd22c2e1a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:47.888358 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5534c1-f10b-4154-b24d-b65ce29830ac None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:47.895058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5534c1-f10b-4154-b24d-b65ce29830ac None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:47.895058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5534c1-f10b-4154-b24d-b65ce29830ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:47.915251 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4b5534c1-f10b-4154-b24d-b65ce29830ac None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:47.917263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4b5534c1-f10b-4154-b24d-b65ce29830ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:48.019960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1201/2419] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:17:48.027559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74589c-d39d-4aba-8b37-79b172bd9fc9 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.027845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74589c-d39d-4aba-8b37-79b172bd9fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.028120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74589c-d39d-4aba-8b37-79b172bd9fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.072128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0b74589c-d39d-4aba-8b37-79b172bd9fc9 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:48.073629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0b74589c-d39d-4aba-8b37-79b172bd9fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:48.095839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1219/2420] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:48.097817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5534c1-f10b-4154-b24d-b65ce29830ac None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:48.109806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5534c1-f10b-4154-b24d-b65ce29830ac None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:48.124772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:48.125438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.125720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.125991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.126828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:17:48.127136 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:48.128802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:48.140781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1202/2421] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:17:48.145488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74589c-d39d-4aba-8b37-79b172bd9fc9 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:48.155617 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74589c-d39d-4aba-8b37-79b172bd9fc9 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:48.161436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:48.162159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.162704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.162842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.163481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:48.165421 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:48.218391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:48.220609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:48.240142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5282d6-13e2-400e-8a08-7890c6b28388 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:48.246795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:48.248625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.249285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.249603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] PATH_INFO: `/v3/projects/80bdb68d492243238486145e4267480c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.251368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=80bdb68d492243238486145e4267480c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:48.255167 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:48.287945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1220/2422] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:17:48 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:48.292569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:48.366116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57fa84-d077-468e-9539-081a439688eb admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:48.392241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:48.392241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.392241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.392241 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.392770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:48.392770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:48.537840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80bdb68d492243238486145e4267480c', 'request_id': 'req-3eea3218-1189-44b1-aa95-4637ac8ac26b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:48.594694 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1221/2423] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:17:48 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:17:48.602670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:48.613706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3a79-7ba7-4975-91bb-1d655ccd8a63 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:48.673283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80bdb68d492243238486145e4267480c', 'request_id': 'req-3eea3218-1189-44b1-aa95-4637ac8ac26b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:48.684832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80bdb68d492243238486145e4267480c', 'request_id': 'req-3eea3218-1189-44b1-aa95-4637ac8ac26b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:48.692092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:48.692776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.693236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.693526 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.693705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] The token cache is being invalidate because project 80bdb68d492243238486145e4267480c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:17:48.693998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:48.694288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:48.694802 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:48.696075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:48.706873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1203/2424] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:17:48 2022] DELETE /identity/v3/projects/80bdb68d492243238486145e4267480c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:48.712494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1222/2425] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:17:48.718384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:48.720115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:48.737721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea3218-1189-44b1-aa95-4637ac8ac26b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:48.742774 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78509b-0536-4136-9f89-92e8b55720b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:48.759198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78509b-0536-4136-9f89-92e8b55720b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.759198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78509b-0536-4136-9f89-92e8b55720b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.759198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78509b-0536-4136-9f89-92e8b55720b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.759198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78509b-0536-4136-9f89-92e8b55720b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:48.759198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78509b-0536-4136-9f89-92e8b55720b4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:48.759198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1204/2426] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:17:48.762115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:48.774305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b66b6-e041-4cb2-8ed6-a924f7984bb1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:48.779537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:48.780484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.780773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.781055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] PATH_INFO: `/v3/projects/b1f92d1febf84c289d423ad1dd7da188/users/5ca75537eef74c798cfd9c90e3999a03/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.800200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f92d1febf84c289d423ad1dd7da188, user_id=5ca75537eef74c798cfd9c90e3999a03, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:48.803441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:48.925893 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1223/2427] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:17:48 2022] PUT /identity/v3/projects/b1f92d1febf84c289d423ad1dd7da188/users/5ca75537eef74c798cfd9c90e3999a03/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:48.939382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128842c-41aa-4432-9e5d-9ed2f186cdf9 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:48.940263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128842c-41aa-4432-9e5d-9ed2f186cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:48.940964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128842c-41aa-4432-9e5d-9ed2f186cdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:48.991972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a128842c-41aa-4432-9e5d-9ed2f186cdf9 None None] MFA Rules not processed for user `5ca75537eef74c798cfd9c90e3999a03`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:48.993346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a128842c-41aa-4432-9e5d-9ed2f186cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:49.111128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1205/2428] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:17:49.123428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:49.125167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:49.193654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1378cd2-43b4-4d90-8320-dcded1211fb5 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:49.197569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:49.198222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:49.198596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:49.198824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:49.207923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:49.209352 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:49.218693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1224/2429] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:17:58.412111 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7187e3d-cc31-4c90-9506-2801b4e4e196 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:58.412798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7187e3d-cc31-4c90-9506-2801b4e4e196 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:58.412798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7187e3d-cc31-4c90-9506-2801b4e4e196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:58.434921 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-c7187e3d-cc31-4c90-9506-2801b4e4e196 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:58.438409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c7187e3d-cc31-4c90-9506-2801b4e4e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:58.500632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1206/2430] 10.222.0.58 () {58 vars in 967 bytes} [Thu Mar 31 18:17:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:58.515266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:58.529880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:58.594739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a341-3d08-43ee-80d7-b3ce689bd3af service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:58.601493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdb929-6884-48af-9f2b-28fa3ba836e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:58.601815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdb929-6884-48af-9f2b-28fa3ba836e9 service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:58.602101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdb929-6884-48af-9f2b-28fa3ba836e9 service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:58.602373 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdb929-6884-48af-9f2b-28fa3ba836e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:58.612020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdb929-6884-48af-9f2b-28fa3ba836e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:58.613704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdb929-6884-48af-9f2b-28fa3ba836e9 service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:58.622646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1225/2431] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:17:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:17:58.851501 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7187e3d-cc31-4c90-9506-2801b4e4e196 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:58.944348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7187e3d-cc31-4c90-9506-2801b4e4e196 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:58.949011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:58.949890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:58.950369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:58.950689 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] PATH_INFO: `/v3/users/5ca75537eef74c798cfd9c90e3999a03` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:58.952039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca75537eef74c798cfd9c90e3999a03)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:58.953953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:59.251338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca75537eef74c798cfd9c90e3999a03'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:59.358181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca75537eef74c798cfd9c90e3999a03'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:59.370993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca75537eef74c798cfd9c90e3999a03'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:59.371749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca75537eef74c798cfd9c90e3999a03'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:59.372412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca75537eef74c798cfd9c90e3999a03'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:17:59.385934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1207/2432] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:17:58 2022] DELETE /identity/v3/users/5ca75537eef74c798cfd9c90e3999a03 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:17:59.391742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:59.391742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:59.391742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:59.413005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:17:59.415159 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:59.485639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1226/2433] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:17:59.495314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:17:59.496761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:17:59.554547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f531125-622e-4889-92bc-0e06aacce4a8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:17:59.558197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32e342-7316-4a30-814e-4e1489d65ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:17:59.558889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e342-7316-4a30-814e-4e1489d65ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:17:59.564684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e342-7316-4a30-814e-4e1489d65ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:17:59.564684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e342-7316-4a30-814e-4e1489d65ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:17:59.569964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32e342-7316-4a30-814e-4e1489d65ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:17:59.571503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32e342-7316-4a30-814e-4e1489d65ad8 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:17:59.582043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1208/2434] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:00.193839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:00.195328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:00.208513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6a26-dce8-407c-84b5-a7f37966220b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:00.213187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:00.214075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:00.214359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:00.214737 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] PATH_INFO: `/v3/projects/b1f92d1febf84c289d423ad1dd7da188` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:00.215948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f92d1febf84c289d423ad1dd7da188)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:00.217872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:00.368329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f92d1febf84c289d423ad1dd7da188', 'request_id': 'req-7817ba1b-5401-4e1e-86be-e97daaf35ee7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:00.373675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f92d1febf84c289d423ad1dd7da188', 'request_id': 'req-7817ba1b-5401-4e1e-86be-e97daaf35ee7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:00.466161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f92d1febf84c289d423ad1dd7da188', 'request_id': 'req-7817ba1b-5401-4e1e-86be-e97daaf35ee7'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:00.477678 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] The token cache is being invalidate because project b1f92d1febf84c289d423ad1dd7da188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:18:00.477962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:00.478596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7817ba1b-5401-4e1e-86be-e97daaf35ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:00.480158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1227/2435] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:18:00 2022] DELETE /identity/v3/projects/b1f92d1febf84c289d423ad1dd7da188 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:00.485410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058108-5a60-4b89-8961-13edd47df6fb None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:00.486215 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058108-5a60-4b89-8961-13edd47df6fb None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:00.486678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058108-5a60-4b89-8961-13edd47df6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:00.505407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-42058108-5a60-4b89-8961-13edd47df6fb None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:00.506666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-42058108-5a60-4b89-8961-13edd47df6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:00.570300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1209/2436] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:00.579594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206499c-5659-4625-801d-0ed3ae8ad949 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:00.579870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206499c-5659-4625-801d-0ed3ae8ad949 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:00.580329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206499c-5659-4625-801d-0ed3ae8ad949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:00.599198 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c206499c-5659-4625-801d-0ed3ae8ad949 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:00.600407 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c206499c-5659-4625-801d-0ed3ae8ad949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:00.608484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1228/2437] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:00.613654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058108-5a60-4b89-8961-13edd47df6fb None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:00.629594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058108-5a60-4b89-8961-13edd47df6fb None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:00.629705 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:00.630311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:00.630591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:00.630893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:00.631888 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:18:00.632197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:00.633791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:00.647238 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1210/2438] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:18:00.651570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206499c-5659-4625-801d-0ed3ae8ad949 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:00.661272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206499c-5659-4625-801d-0ed3ae8ad949 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:00.666477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:00.667079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:00.667851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:00.667851 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:00.668853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:00.670324 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:00.799081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1229/2439] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:18:00 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:18:00.803001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:00.812816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfba8a-e8f6-4010-adf1-b908eb837511 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:00.868069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:00.868739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:00.869022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:00.869300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:00.870067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:00.872489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:00.963692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1211/2440] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:18:00 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:00.967727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:00.978594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cd4d5-044a-4f47-93b6-ac1de4fe5338 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:00.983398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:00.984122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:00.984439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:00.984712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:00.985435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:00.987764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:00.999620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1230/2441] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:01.003725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:01.013896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47ee04-b666-4574-b1bf-7a9cd2e05f4f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:01.019314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac07f-d75e-4121-ac9f-2c375506ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:01.019976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac07f-d75e-4121-ac9f-2c375506ec7b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:01.020256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac07f-d75e-4121-ac9f-2c375506ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:01.020528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac07f-d75e-4121-ac9f-2c375506ec7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:01.021249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac07f-d75e-4121-ac9f-2c375506ec7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:01.022870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac07f-d75e-4121-ac9f-2c375506ec7b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:01.033580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1212/2442] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:18:01.037953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:01.048142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50577-07c7-414e-af51-3d9508372eb4 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:01.054259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:01.055123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:01.055403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:01.055677 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] PATH_INFO: `/v3/projects/10c09876736547b59f4bb56fa5740f5f/users/6f1d5c7f14e2491aa217a7d2939fe962/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:01.070895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c09876736547b59f4bb56fa5740f5f, user_id=6f1d5c7f14e2491aa217a7d2939fe962, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:01.073553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:01.152165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1231/2443] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:01 2022] PUT /identity/v3/projects/10c09876736547b59f4bb56fa5740f5f/users/6f1d5c7f14e2491aa217a7d2939fe962/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:01.157261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:01.158151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:01.158452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:01.177244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:01.178446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:01.237444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1213/2444] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:01.247203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:01.249024 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:01.305999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17672f-15a8-472d-8ce9-e611b72a8a33 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:01.309640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfdc3a-32b8-4479-940d-810dc93cbcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:01.310286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfdc3a-32b8-4479-940d-810dc93cbcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:01.310567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfdc3a-32b8-4479-940d-810dc93cbcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:01.310896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfdc3a-32b8-4479-940d-810dc93cbcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:01.320237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfdc3a-32b8-4479-940d-810dc93cbcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:01.326150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfdc3a-32b8-4479-940d-810dc93cbcc4 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:01.332087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1232/2445] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:07.087612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:07.093410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:07.113590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cb649-3dc6-48ec-9e55-eac134294df8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:07.120624 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:07.122302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:07.122790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:07.123226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] PATH_INFO: `/v3/users/37dd6eaa597d4b61b3c7f3719217baa1` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:07.125067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37dd6eaa597d4b61b3c7f3719217baa1)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:07.128024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:07.252430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40232d8e-efe0-4355-b4a6-45c447f41489 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:07.252892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40232d8e-efe0-4355-b4a6-45c447f41489 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:07.253122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40232d8e-efe0-4355-b4a6-45c447f41489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:07.282679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-40232d8e-efe0-4355-b4a6-45c447f41489 None None] MFA Rules not processed for user `6f1d5c7f14e2491aa217a7d2939fe962`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:07.283641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-40232d8e-efe0-4355-b4a6-45c447f41489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:07.348761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37dd6eaa597d4b61b3c7f3719217baa1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:07.355472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1233/2446] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:18:07.360605 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40232d8e-efe0-4355-b4a6-45c447f41489 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:07.371620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40232d8e-efe0-4355-b4a6-45c447f41489 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:07.376988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:07.377743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:07.377906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:07.378215 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:07.382815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:07.382815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:07.419799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37dd6eaa597d4b61b3c7f3719217baa1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:07.434763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37dd6eaa597d4b61b3c7f3719217baa1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:07.435430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37dd6eaa597d4b61b3c7f3719217baa1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:07.436034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37dd6eaa597d4b61b3c7f3719217baa1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:07.448353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1214/2447] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:18:07 2022] DELETE /identity/v3/users/37dd6eaa597d4b61b3c7f3719217baa1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:07.530780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1234/2448] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:18:07 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:18:07.536140 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:07.537653 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:07.603370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9c9a-21f1-48b7-ab21-8d22a3e14160 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:07.658890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:07.659605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:07.659846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:07.660122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:07.660821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:07.662768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:07.713499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:07.715229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:07.729514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fca89f-cd99-4fbd-a3fb-f962a4ba0e35 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:07.734902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:07.737201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:07.737646 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:07.738086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] PATH_INFO: `/v3/projects/b2d7dee7188943ae84823848038e5357` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:07.739834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d7dee7188943ae84823848038e5357)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:07.742020 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:07.792314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1215/2449] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:18:07 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:07.795984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:07.807949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9335031-7186-4cf5-9111-c93ca31b825b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:07.819338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:07.820013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:07.820294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:07.820570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:07.821325 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:07.823008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:07.833438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1216/2450] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:18:07.839171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:07.849925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ca9b-1b99-4d6d-b92e-39968ed3ab9d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:07.854586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:07.855490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:07.855767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:07.856038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] PATH_INFO: `/v3/projects/852d16fa9ffc499280fca9e91b225101/users/875eead6ee1a49b6a35d0affe7696b8a/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:07.871978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d16fa9ffc499280fca9e91b225101, user_id=875eead6ee1a49b6a35d0affe7696b8a, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:07.882538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:07.945988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1217/2451] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:07 2022] PUT /identity/v3/projects/852d16fa9ffc499280fca9e91b225101/users/875eead6ee1a49b6a35d0affe7696b8a/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:18:07.949869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:07.953666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d7dee7188943ae84823848038e5357', 'request_id': 'req-7a28b2b1-1869-4b00-a491-d98d3f31be30'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:07.959611 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d7dee7188943ae84823848038e5357', 'request_id': 'req-7a28b2b1-1869-4b00-a491-d98d3f31be30'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:08.012680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94322-728d-4000-861e-1dff6e842350 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.025434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d7dee7188943ae84823848038e5357', 'request_id': 'req-7a28b2b1-1869-4b00-a491-d98d3f31be30'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:08.037978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] The token cache is being invalidate because project b2d7dee7188943ae84823848038e5357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:18:08.039133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:08.039133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7a28b2b1-1869-4b00-a491-d98d3f31be30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:08.040791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1235/2452] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:18:07 2022] DELETE /identity/v3/projects/b2d7dee7188943ae84823848038e5357 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:18:08.045647 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092415c1-11b5-4d97-9a59-e50a2aae892e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.046154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092415c1-11b5-4d97-9a59-e50a2aae892e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.046567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092415c1-11b5-4d97-9a59-e50a2aae892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.069361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.070071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.070356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.070636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-092415c1-11b5-4d97-9a59-e50a2aae892e None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:08.070801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.071380 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.071842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-092415c1-11b5-4d97-9a59-e50a2aae892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:08.072992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.085833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1218/2453] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:18:08.090869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1236/2454] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:08.093421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:08.095741 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:08.098031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9a014-1fae-444a-87b0-c40850a154ad None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.098318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9a014-1fae-444a-87b0-c40850a154ad None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.098597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9a014-1fae-444a-87b0-c40850a154ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.110671 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dc7d7-5e06-48a1-9f9b-adc0a269d7b0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.117085 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.118068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.118591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.118880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7ae9a014-1fae-444a-87b0-c40850a154ad None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:08.119032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] PATH_INFO: `/v3/projects/852d16fa9ffc499280fca9e91b225101/users/875eead6ee1a49b6a35d0affe7696b8a/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.120480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7ae9a014-1fae-444a-87b0-c40850a154ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:08.121200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d16fa9ffc499280fca9e91b225101, user_id=875eead6ee1a49b6a35d0affe7696b8a, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.124172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.137205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1237/2455] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:18:08.137327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1219/2456] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:08 2022] PUT /identity/v3/projects/852d16fa9ffc499280fca9e91b225101/users/875eead6ee1a49b6a35d0affe7696b8a/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:08.140068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9a014-1fae-444a-87b0-c40850a154ad None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:08.150038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9a014-1fae-444a-87b0-c40850a154ad None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.207338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.208061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.208347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.208628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.209564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:18:08.209877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.211594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.228044 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1238/2457] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:18:08.229195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:08.240728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a1f1-c8cd-4483-8591-c98c771cbc96 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.245545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.246222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.246537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.246869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.255706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.257702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.434346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1220/2458] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:18:08 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:18:08.439585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:08.449510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63e2b-0535-46fd-87ef-42f34c48889c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.514592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.527951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.527951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.527951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.527951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.527951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.646853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1239/2459] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:18:08 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:08.648144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:08.658312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429990d3-efd7-41c4-bc3c-652ea86bb74f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.663441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.664106 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.664389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.664661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.665378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.667001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.677427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1221/2460] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:08.697449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:08.708838 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d12ce-d2ec-4a94-98cf-ba54b5bb5053 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.713983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7625c-cf79-4727-9a3b-b34504b8396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.714732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7625c-cf79-4727-9a3b-b34504b8396f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.715194 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7625c-cf79-4727-9a3b-b34504b8396f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.715527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7625c-cf79-4727-9a3b-b34504b8396f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.716298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7625c-cf79-4727-9a3b-b34504b8396f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.717973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7625c-cf79-4727-9a3b-b34504b8396f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.729550 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1240/2461] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:08.733627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:08.744704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20c74-26c8-4450-98e9-fccb260e0a33 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:08.750012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:08.751636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.751977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.752411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] PATH_INFO: `/v3/projects/36bcc6f634b9419bb55d698a2d3872af/users/7b67d196ce52487bbdbc4eb4bd5b9d08/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.770959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bcc6f634b9419bb55d698a2d3872af, user_id=7b67d196ce52487bbdbc4eb4bd5b9d08, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:08.773738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:08.837226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1222/2462] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:08 2022] PUT /identity/v3/projects/36bcc6f634b9419bb55d698a2d3872af/users/7b67d196ce52487bbdbc4eb4bd5b9d08/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:08.847397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c547c-2ad7-4eca-bd6f-27cdba9c62bf None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:08.847602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c547c-2ad7-4eca-bd6f-27cdba9c62bf None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:08.847882 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c547c-2ad7-4eca-bd6f-27cdba9c62bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:08.898881 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-658c547c-2ad7-4eca-bd6f-27cdba9c62bf None None] MFA Rules not processed for user `7b67d196ce52487bbdbc4eb4bd5b9d08`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:08.900379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-658c547c-2ad7-4eca-bd6f-27cdba9c62bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:08.986332 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1241/2463] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:18:08.998924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:09.000757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:09.079754 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48a3b-ab50-458d-bb64-54d881fb8e02 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:09.085651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:09.086948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:09.087586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:09.087967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:09.101663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:09.103567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:09.116481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1223/2464] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:14.932172 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf55c4-4921-4905-915f-1e47f0ebb854 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:14.932668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf55c4-4921-4905-915f-1e47f0ebb854 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:14.932765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf55c4-4921-4905-915f-1e47f0ebb854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:14.961506 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-8eaf55c4-4921-4905-915f-1e47f0ebb854 None None] MFA Rules not processed for user `875eead6ee1a49b6a35d0affe7696b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:14.962762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8eaf55c4-4921-4905-915f-1e47f0ebb854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:15.177777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1242/2465] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:15.191000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:15.192537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:15.293518 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f13a2-b906-4ca0-8278-9f642da3cdc8 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:15.300184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:15.300841 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:15.301122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:15.301402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:15.303546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:15.366584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:15.368328 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:15.379204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1224/2466] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:19.018579 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f6a79-386e-40d3-b14f-1742a5ab74f4 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:19.019132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f6a79-386e-40d3-b14f-1742a5ab74f4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:19.019730 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f6a79-386e-40d3-b14f-1742a5ab74f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:19.044218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ae1f6a79-386e-40d3-b14f-1742a5ab74f4 None None] MFA Rules not processed for user `6f1d5c7f14e2491aa217a7d2939fe962`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:19.045522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ae1f6a79-386e-40d3-b14f-1742a5ab74f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:19.053997 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1243/2467] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:18:28.649544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:28.650958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:28.713161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c5a82-785b-479d-b8c0-149a99719fad service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:28.718793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:28.719507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:28.719823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:28.720095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] PATH_INFO: `/v3/users/8f51691703864964bb7fe388e8eda162` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:28.721289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f51691703864964bb7fe388e8eda162)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:28.723224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:28.981330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f51691703864964bb7fe388e8eda162'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.075203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f51691703864964bb7fe388e8eda162'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.088768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f51691703864964bb7fe388e8eda162'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.089523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f51691703864964bb7fe388e8eda162'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.090147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f51691703864964bb7fe388e8eda162'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.104782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1225/2468] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:18:28 2022] DELETE /identity/v3/users/8f51691703864964bb7fe388e8eda162 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:29.109984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:29.115485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:29.115485 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:29.127719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:29.128895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:29.190386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1244/2469] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:29.200097 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:29.201467 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:29.259145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e588-d34a-4cc5-a4c8-1d926b503add admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:29.262715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:29.263359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:29.263640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:29.263914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:29.273819 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:29.275281 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:29.285139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1226/2470] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:29.420800 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:29.422359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:29.435376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29223e-9f82-44ca-90af-9282be7c8bf0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:29.452050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:29.452050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:29.452050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:29.452050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] PATH_INFO: `/v3/users/7b67d196ce52487bbdbc4eb4bd5b9d08` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:29.453370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b67d196ce52487bbdbc4eb4bd5b9d08)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:29.453370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:29.724629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b67d196ce52487bbdbc4eb4bd5b9d08'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.725440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b67d196ce52487bbdbc4eb4bd5b9d08'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.732290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b67d196ce52487bbdbc4eb4bd5b9d08'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.752840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:29.754424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:29.767716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0074da-521c-4d39-b525-9e45054763ff service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:29.775786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:29.776729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:29.777076 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:29.777416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] PATH_INFO: `/v3/projects/4b7b4d8756a44c2fbf560ff42e8f169b` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:29.779334 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7b4d8756a44c2fbf560ff42e8f169b)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:29.781858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:29.817796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b67d196ce52487bbdbc4eb4bd5b9d08'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.818424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-67e36aaa-2628-4274-b3a6-6228789d806a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b67d196ce52487bbdbc4eb4bd5b9d08'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.836103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1245/2471] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:18:29 2022] DELETE /identity/v3/users/7b67d196ce52487bbdbc4eb4bd5b9d08 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:29.840454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:29.844985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:29.844985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:29.859201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:29.860446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:29.917234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7b4d8756a44c2fbf560ff42e8f169b', 'request_id': 'req-b10cb1c9-ebc4-4859-a862-820ba49a408f'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:29.925468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1246/2472] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:18:29.935321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:29.937290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:29.997029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d961c0-4e82-46e9-b347-0f4530564ec3 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:30.003194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7b4d8756a44c2fbf560ff42e8f169b', 'request_id': 'req-b10cb1c9-ebc4-4859-a862-820ba49a408f'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:30.013577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7b4d8756a44c2fbf560ff42e8f169b', 'request_id': 'req-b10cb1c9-ebc4-4859-a862-820ba49a408f'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:30.025545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] The token cache is being invalidate because project 4b7b4d8756a44c2fbf560ff42e8f169b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:18:30.025947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:30.028300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:30.028413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1227/2473] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:18:29 2022] DELETE /identity/v3/projects/4b7b4d8756a44c2fbf560ff42e8f169b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:30.052093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff697f1-5046-4cf2-95e0-e90cbdf87472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:30.052759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff697f1-5046-4cf2-95e0-e90cbdf87472 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:30.053038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff697f1-5046-4cf2-95e0-e90cbdf87472 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:30.053319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff697f1-5046-4cf2-95e0-e90cbdf87472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:30.055263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2ff697f1-5046-4cf2-95e0-e90cbdf87472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:30.134169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff697f1-5046-4cf2-95e0-e90cbdf87472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:30.136540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff697f1-5046-4cf2-95e0-e90cbdf87472 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:30.163720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1247/2474] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:18:30.722166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:30.723727 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:30.737207 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb1c9-ebc4-4859-a862-820ba49a408f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:30.741724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:30.742622 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:30.742893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:30.743170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] PATH_INFO: `/v3/projects/36bcc6f634b9419bb55d698a2d3872af` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:30.744339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bcc6f634b9419bb55d698a2d3872af)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:30.746301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:30.882491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bcc6f634b9419bb55d698a2d3872af', 'request_id': 'req-7b7dfdd0-ff38-496d-9b5d-165b21589995'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:31.040501 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bcc6f634b9419bb55d698a2d3872af', 'request_id': 'req-7b7dfdd0-ff38-496d-9b5d-165b21589995'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:31.048776 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bcc6f634b9419bb55d698a2d3872af', 'request_id': 'req-7b7dfdd0-ff38-496d-9b5d-165b21589995'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:31.061586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] The token cache is being invalidate because project 36bcc6f634b9419bb55d698a2d3872af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:18:31.061908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:31.062805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7b7dfdd0-ff38-496d-9b5d-165b21589995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:31.065248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1228/2475] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:18:30 2022] DELETE /identity/v3/projects/36bcc6f634b9419bb55d698a2d3872af => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:31.070206 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942e47c-3c00-4c87-b369-1fec55ea6c90 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.070488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942e47c-3c00-4c87-b369-1fec55ea6c90 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.070783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942e47c-3c00-4c87-b369-1fec55ea6c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.088138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-5942e47c-3c00-4c87-b369-1fec55ea6c90 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:31.089308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-5942e47c-3c00-4c87-b369-1fec55ea6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:31.149334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1248/2476] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:31.157444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7ea4-25a0-4972-a9c6-94306045ab04 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.157730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7ea4-25a0-4972-a9c6-94306045ab04 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.158004 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7ea4-25a0-4972-a9c6-94306045ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.176529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-377f7ea4-25a0-4972-a9c6-94306045ab04 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:31.177732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-377f7ea4-25a0-4972-a9c6-94306045ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:31.185390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1229/2477] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:31.189777 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942e47c-3c00-4c87-b369-1fec55ea6c90 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:31.199263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942e47c-3c00-4c87-b369-1fec55ea6c90 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:31.203829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:31.204500 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.204785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.205061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.205781 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:18:31.206089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:31.207739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:31.220117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1249/2478] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:18:31.224609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f7ea4-25a0-4972-a9c6-94306045ab04 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:31.234911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f7ea4-25a0-4972-a9c6-94306045ab04 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:31.239598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:31.240243 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.240521 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.240828 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.241528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:31.243440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:31.395257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1230/2479] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:18:31 2022] POST /identity/v3/projects => generated 395 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:31.397409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:31.407951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd94ea3-222c-4ab9-8b2a-0152562cbbaf admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:31.464289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:31.465131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.465409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.465683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.466361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:31.468915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:31.564223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1250/2480] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:18:31 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:31.565369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:31.576719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8168b0-c078-4ac2-8606-4ec945ae66fd admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:31.581692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:31.582415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.582766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.583002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.583730 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:31.585306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:31.596908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1231/2481] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:31.601251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:31.611313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141dd1-f991-426b-a353-a29457bcbe39 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:31.615848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89da4c-7e7d-4997-995f-bc743f8093e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:31.616502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89da4c-7e7d-4997-995f-bc743f8093e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.616778 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89da4c-7e7d-4997-995f-bc743f8093e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.617048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89da4c-7e7d-4997-995f-bc743f8093e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.617763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89da4c-7e7d-4997-995f-bc743f8093e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:31.619409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89da4c-7e7d-4997-995f-bc743f8093e2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:31.630053 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1251/2482] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:18:31.634145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:31.645885 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9400a-41eb-4818-881d-e993a1775b68 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:31.650699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:31.651597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.651890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.652163 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] PATH_INFO: `/v3/projects/4f027e8b823f4b2cb266b0631ecb62d0/users/1c7bc7545d2d4dde83799da7fe6ba031/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.667845 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f027e8b823f4b2cb266b0631ecb62d0, user_id=1c7bc7545d2d4dde83799da7fe6ba031, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:31.670414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:31.753155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1232/2483] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:31 2022] PUT /identity/v3/projects/4f027e8b823f4b2cb266b0631ecb62d0/users/1c7bc7545d2d4dde83799da7fe6ba031/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:31.764532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.765443 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.765704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.792614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] MFA Rules not processed for user `1c7bc7545d2d4dde83799da7fe6ba031`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:31.793819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:31.859174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1252/2484] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:31.870728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:31.872546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:31.931691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be484-862b-4282-8e92-248e72374a88 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:31.933352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:31.934016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:31.934324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:31.934599 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:31.943556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:31.945288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:31.956971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1233/2485] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:41.059654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:41.061484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:41.117309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c494b-bbad-486f-bbb2-e5b971666dc1 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:41.121109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690bd99-2fa1-4e29-b97f-8c7b9704d7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:41.121751 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690bd99-2fa1-4e29-b97f-8c7b9704d7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:41.122027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690bd99-2fa1-4e29-b97f-8c7b9704d7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:41.122359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690bd99-2fa1-4e29-b97f-8c7b9704d7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:41.124287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4690bd99-2fa1-4e29-b97f-8c7b9704d7e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:41.194026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690bd99-2fa1-4e29-b97f-8c7b9704d7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:41.195474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690bd99-2fa1-4e29-b97f-8c7b9704d7e7 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:41.206520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1253/2486] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:42.382917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:42.384351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:42.396353 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174752d1-cda1-416b-af22-ad1483f54052 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:42.399897 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:42.400527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:42.400806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:42.401079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:42.402796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:42.416237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:42.417646 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:42.428868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1234/2487] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:43.791380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc3d40-3b91-458c-b90e-84908a952c4a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:43.791856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc3d40-3b91-458c-b90e-84908a952c4a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:43.791954 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc3d40-3b91-458c-b90e-84908a952c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:43.810977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-84dc3d40-3b91-458c-b90e-84908a952c4a None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:43.812180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-84dc3d40-3b91-458c-b90e-84908a952c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:43.868864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1254/2488] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:18:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:18:43.892258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:43.893728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:43.962270 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343269-7962-490e-98dd-be6a3b7003e9 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:43.967929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13848675-fd19-4dec-9fee-5d03202b595e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:43.968750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13848675-fd19-4dec-9fee-5d03202b595e service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:43.969033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13848675-fd19-4dec-9fee-5d03202b595e service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:43.969306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13848675-fd19-4dec-9fee-5d03202b595e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:43.978196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13848675-fd19-4dec-9fee-5d03202b595e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:43.979793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13848675-fd19-4dec-9fee-5d03202b595e service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:43.988936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1235/2489] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:18:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:18:47.099112 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc3d40-3b91-458c-b90e-84908a952c4a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:47.169602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc3d40-3b91-458c-b90e-84908a952c4a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:47.174337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:47.175351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:47.175696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:47.176041 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] PATH_INFO: `/v3/users/1c7bc7545d2d4dde83799da7fe6ba031` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:47.177300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7bc7545d2d4dde83799da7fe6ba031)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:47.179329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:47.540917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7bc7545d2d4dde83799da7fe6ba031'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:47.541984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7bc7545d2d4dde83799da7fe6ba031'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:47.552496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7bc7545d2d4dde83799da7fe6ba031'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:47.673817 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7bc7545d2d4dde83799da7fe6ba031'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:47.674555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7bc7545d2d4dde83799da7fe6ba031'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:47.693239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1255/2490] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:18:47 2022] DELETE /identity/v3/users/1c7bc7545d2d4dde83799da7fe6ba031 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:47.697949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:47.698495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:47.698495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:47.718810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:47.720306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:47.798808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1236/2491] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:47.806627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:47.809494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:47.874875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e800a-5898-4297-b69a-3f38ad996de8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:47.878556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efec4f-58b4-4b76-ab2a-2edbcf244a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:47.879293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efec4f-58b4-4b76-ab2a-2edbcf244a84 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:47.879578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efec4f-58b4-4b76-ab2a-2edbcf244a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:47.879896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efec4f-58b4-4b76-ab2a-2edbcf244a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:47.892221 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efec4f-58b4-4b76-ab2a-2edbcf244a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:47.893738 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efec4f-58b4-4b76-ab2a-2edbcf244a84 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:47.903651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1256/2492] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:48.367280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:48.368692 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:48.391578 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decfc88-10dd-4edf-9d95-22b026360be7 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:48.397647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:48.399057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:48.399057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:48.399560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] PATH_INFO: `/v3/projects/4f027e8b823f4b2cb266b0631ecb62d0` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:48.400728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f027e8b823f4b2cb266b0631ecb62d0)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:48.402746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:48.572517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f027e8b823f4b2cb266b0631ecb62d0', 'request_id': 'req-c4570c02-3abf-45e0-9094-5ffec115dfb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:48.634020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f027e8b823f4b2cb266b0631ecb62d0', 'request_id': 'req-c4570c02-3abf-45e0-9094-5ffec115dfb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:48.641268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f027e8b823f4b2cb266b0631ecb62d0', 'request_id': 'req-c4570c02-3abf-45e0-9094-5ffec115dfb8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:48.653491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] The token cache is being invalidate because project 4f027e8b823f4b2cb266b0631ecb62d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:18:48.653900 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:48.654665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-c4570c02-3abf-45e0-9094-5ffec115dfb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:18:48.660130 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1237/2493] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:18:48 2022] DELETE /identity/v3/projects/4f027e8b823f4b2cb266b0631ecb62d0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:48.661852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6a04-55d9-4257-a634-67289788e78b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:48.662323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6a04-55d9-4257-a634-67289788e78b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:48.662437 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6a04-55d9-4257-a634-67289788e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:48.682191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-872c6a04-55d9-4257-a634-67289788e78b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:48.683665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-872c6a04-55d9-4257-a634-67289788e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:48.749284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1257/2494] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:48.757293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89e6f0-4a2f-4232-a332-92d95250364a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:48.757783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89e6f0-4a2f-4232-a332-92d95250364a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:48.758053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89e6f0-4a2f-4232-a332-92d95250364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:48.779403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-bc89e6f0-4a2f-4232-a332-92d95250364a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:48.780719 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bc89e6f0-4a2f-4232-a332-92d95250364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:48.788893 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1238/2495] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:48.793378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c6a04-55d9-4257-a634-67289788e78b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:48.803762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c6a04-55d9-4257-a634-67289788e78b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:48.808742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:48.809404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:48.809702 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:48.810004 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:48.811546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:18:48.811868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:48.813454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:48.825663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1258/2496] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:18:48.830186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89e6f0-4a2f-4232-a332-92d95250364a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:48.840109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89e6f0-4a2f-4232-a332-92d95250364a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:48.847507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:48.849176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:48.849480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:48.849865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:48.850686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:48.852721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:48.927489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1239/2497] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:18:48 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:48.931478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:48.941762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedf7d-fbc8-4ca5-aac8-ec32ceaa70f7 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:49.010948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:49.012837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:49.012837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:49.012837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:49.012837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:49.015492 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:49.125183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1259/2498] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:18:48 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:49.126811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:49.138804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8c506-d571-40ce-b9c8-d2b14aa5bb82 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:49.144753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:49.145418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:49.145698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:49.145987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:49.146734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:49.148329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:49.166834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:49.167366 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1240/2499] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:49.179093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04fde-720e-42b3-a31b-dfea1956e238 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:49.184519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9534c-65bd-4ecb-a67e-b8ac59153b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:49.185286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9534c-65bd-4ecb-a67e-b8ac59153b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:49.185928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9534c-65bd-4ecb-a67e-b8ac59153b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:49.186211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9534c-65bd-4ecb-a67e-b8ac59153b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:49.186977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9534c-65bd-4ecb-a67e-b8ac59153b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:49.188603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9534c-65bd-4ecb-a67e-b8ac59153b92 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:49.199823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1260/2500] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:49.204352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:49.215206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e852ee-207d-4e70-80c8-cbd643fdb5b0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:49.221656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:49.222677 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:49.223030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:49.223378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] PATH_INFO: `/v3/projects/70f0b3390f4542c8831753ecf26f6745/users/7c5ea90eba174068877cdcc1594ccda4/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:49.242491 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f0b3390f4542c8831753ecf26f6745, user_id=7c5ea90eba174068877cdcc1594ccda4, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:49.245305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:49.323710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1241/2501] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:49 2022] PUT /identity/v3/projects/70f0b3390f4542c8831753ecf26f6745/users/7c5ea90eba174068877cdcc1594ccda4/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:49.330641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:49.331164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:49.331568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:49.350669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:49.352113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:49.423138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1261/2502] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:49.430914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:49.434736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:49.505988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f5f70-2e5c-421e-b413-6308d641df52 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:49.510065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e980f00-091b-46fa-998f-fe983de73834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:49.510948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e980f00-091b-46fa-998f-fe983de73834 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:49.511403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e980f00-091b-46fa-998f-fe983de73834 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:49.511846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e980f00-091b-46fa-998f-fe983de73834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:49.526149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e980f00-091b-46fa-998f-fe983de73834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:49.528535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e980f00-091b-46fa-998f-fe983de73834 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:49.538497 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1242/2503] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:18:52.096603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:52.098099 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:52.232803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2cf8f-bfda-433e-a83e-fef6162e5a85 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:52.252875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:52.254953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:52.255317 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:52.255690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:52.264145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:52.423430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:52.425054 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:52.440854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1262/2504] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:18:56.758309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb30b7-b709-4db3-b38b-76973f13bdf2 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:56.758834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb30b7-b709-4db3-b38b-76973f13bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:56.758938 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb30b7-b709-4db3-b38b-76973f13bdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:56.797793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-fbfb30b7-b709-4db3-b38b-76973f13bdf2 None None] MFA Rules not processed for user `7c5ea90eba174068877cdcc1594ccda4`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:18:56.799485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fbfb30b7-b709-4db3-b38b-76973f13bdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:56.890426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1243/2505] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:18:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:18:56.894685 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:56.909287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5385f0-1c3d-4d05-a79f-6989cee79ec7 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:56.915629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:56.916731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:56.917025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:56.917305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:56.918290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:56.921021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:57.050593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1263/2506] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:18:56 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:18:57.058302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb30b7-b709-4db3-b38b-76973f13bdf2 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:57.072064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb30b7-b709-4db3-b38b-76973f13bdf2 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:57.134008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:57.134726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:57.135011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:57.135289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:57.136321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:57.139218 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:57.256932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1244/2507] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:18:57 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:18:57.260775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:57.271797 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52de82-ba52-4aa2-b2b5-810b07c2d617 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:57.276384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:57.277048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:57.277364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:57.277637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:57.278480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:57.280133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:57.291494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1264/2508] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:57.295706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:57.305996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21029bab-819a-40a6-a666-0bdef92f2467 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:57.311378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:57.312273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:57.312684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:57.312991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] PATH_INFO: `/v3/projects/925b9541efdf4ed084c2a62b9434089e/users/e0183fefb5d74782bba4b90745a6dc50/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:57.329546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] RBAC: Authorizing `identity:create_grant(project_id=925b9541efdf4ed084c2a62b9434089e, user_id=e0183fefb5d74782bba4b90745a6dc50, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:57.332217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:57.457038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1245/2509] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:57 2022] PUT /identity/v3/projects/925b9541efdf4ed084c2a62b9434089e/users/e0183fefb5d74782bba4b90745a6dc50/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:18:57.460935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:57.471122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c5a02-6b85-4ebc-bb7b-2bce54127d97 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:57.530663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:57.531613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:57.531984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:57.532347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:57.533338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:57.535257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:57.546311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1265/2510] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:18:57.550248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:57.562329 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d732-ffdb-4bcd-b913-e8c04dcc025c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:57.568608 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:57.568791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:57.569132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:57.569485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] PATH_INFO: `/v3/projects/925b9541efdf4ed084c2a62b9434089e/users/e0183fefb5d74782bba4b90745a6dc50/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:57.571574 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=925b9541efdf4ed084c2a62b9434089e, user_id=e0183fefb5d74782bba4b90745a6dc50, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:57.574286 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:57.585527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1246/2511] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:18:57 2022] PUT /identity/v3/projects/925b9541efdf4ed084c2a62b9434089e/users/e0183fefb5d74782bba4b90745a6dc50/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:18:59.536474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:18:59.647833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a268369-c3f3-4a86-b423-9547a6397d8f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:18:59.716489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f3fe-6b58-43d2-863e-9712806ac0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:18:59.719906 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f3fe-6b58-43d2-863e-9712806ac0ac service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:18:59.720531 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f3fe-6b58-43d2-863e-9712806ac0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:18:59.720986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f3fe-6b58-43d2-863e-9712806ac0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:18:59.723521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4338f3fe-6b58-43d2-863e-9712806ac0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:18:59.736075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f3fe-6b58-43d2-863e-9712806ac0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:18:59.739275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f3fe-6b58-43d2-863e-9712806ac0ac service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:18:59.754527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1266/2512] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:18:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:04.017602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:04.019579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:04.034908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eabc2-96e2-4902-bb81-2efefbe6be8b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:04.039651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:04.040247 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:04.040531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:04.040810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:04.042797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:04.060953 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:04.063402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:04.073079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1247/2513] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:04.084074 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:04.085087 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:04.085795 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:04.131039 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] MFA Rules not processed for user `e0183fefb5d74782bba4b90745a6dc50`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:04.134311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:04.240806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1267/2514] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:19:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:19:04.588678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:04.700148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe40f26-eff4-4232-ae6b-eb153aacec5b service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:04.706800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e72299-cb3f-4e58-a494-0e69383ed428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:04.707465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72299-cb3f-4e58-a494-0e69383ed428 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:04.707752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72299-cb3f-4e58-a494-0e69383ed428 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:04.708027 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72299-cb3f-4e58-a494-0e69383ed428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:04.770840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e72299-cb3f-4e58-a494-0e69383ed428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:04.772821 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e72299-cb3f-4e58-a494-0e69383ed428 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:04.782116 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1248/2515] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:19:04.825804 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:04.827261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:04.924328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc1f8e-03a7-42b5-b203-1afc5537ac5c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:04.929442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4caa20-903b-4afe-86b1-c7c1af5ffb72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:04.930136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4caa20-903b-4afe-86b1-c7c1af5ffb72 service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:04.930446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4caa20-903b-4afe-86b1-c7c1af5ffb72 service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:04.930811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4caa20-903b-4afe-86b1-c7c1af5ffb72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:04.932522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9e4caa20-903b-4afe-86b1-c7c1af5ffb72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:04.945488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4caa20-903b-4afe-86b1-c7c1af5ffb72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:04.947135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4caa20-903b-4afe-86b1-c7c1af5ffb72 service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:04.958511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1268/2516] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:05.213525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a1ffb-4bcc-456f-b232-8963f9697698 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.214018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a1ffb-4bcc-456f-b232-8963f9697698 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.214256 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a1ffb-4bcc-456f-b232-8963f9697698 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.216471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1249/2517] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:19:05.224517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417faf-5af1-4800-8e50-d1730feed488 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.225009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417faf-5af1-4800-8e50-d1730feed488 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.225115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417faf-5af1-4800-8e50-d1730feed488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.283439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c8417faf-5af1-4800-8e50-d1730feed488 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:05.284779 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c8417faf-5af1-4800-8e50-d1730feed488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:05.300610 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1269/2518] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:19:05.308216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a1ffb-4bcc-456f-b232-8963f9697698 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:05.310543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-024a1ffb-4bcc-456f-b232-8963f9697698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:05.391298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a1ffb-4bcc-456f-b232-8963f9697698 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:05.395735 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e4c5-fbc5-40aa-8841-7da47d1101db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bfec7fb739b42bfa2ddd682aa10dc95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:05.397081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e4c5-fbc5-40aa-8841-7da47d1101db service glance] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.397396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e4c5-fbc5-40aa-8841-7da47d1101db service glance] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.397712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e4c5-fbc5-40aa-8841-7da47d1101db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.410525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e4c5-fbc5-40aa-8841-7da47d1101db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:05.412055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e4c5-fbc5-40aa-8841-7da47d1101db service glance] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:05.424635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1250/2519] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:19:05.634554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9943813-6157-408b-a84a-faef1f37443f None None] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.634875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9943813-6157-408b-a84a-faef1f37443f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.635156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9943813-6157-408b-a84a-faef1f37443f None None] PATH_INFO: `/` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.636931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1270/2520] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:19:05.642198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55cb18-2e1e-45ed-a7fe-5e1a3285db2a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.642509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55cb18-2e1e-45ed-a7fe-5e1a3285db2a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.642818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55cb18-2e1e-45ed-a7fe-5e1a3285db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.662079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ea55cb18-2e1e-45ed-a7fe-5e1a3285db2a None None] MFA Rules not processed for user `7436a3068f6545a4b74c877c5b8c81c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:05.663444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ea55cb18-2e1e-45ed-a7fe-5e1a3285db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:05.670981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1251/2521] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:19:05.687789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9943813-6157-408b-a84a-faef1f37443f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:05.703615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9943813-6157-408b-a84a-faef1f37443f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:05.714154 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bef6b6-e042-4c27-ae87-69092715c125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:05.715636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef6b6-e042-4c27-ae87-69092715c125 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.716071 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef6b6-e042-4c27-ae87-69092715c125 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.716494 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef6b6-e042-4c27-ae87-69092715c125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.727259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bef6b6-e042-4c27-ae87-69092715c125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:05.729119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bef6b6-e042-4c27-ae87-69092715c125 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:05.756964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1271/2522] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:19:05.869630 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138ece-48f4-48e6-91ea-f0ec8094fe71 None None] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.870321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138ece-48f4-48e6-91ea-f0ec8094fe71 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.870655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138ece-48f4-48e6-91ea-f0ec8094fe71 None None] PATH_INFO: `/` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.873605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1252/2523] 10.222.0.58 () {54 vars in 921 bytes} [Thu Mar 31 18:19:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 31 18:19:05.880524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b87f-5a75-4d3d-934d-da040c34cce2 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.880840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b87f-5a75-4d3d-934d-da040c34cce2 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.881121 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b87f-5a75-4d3d-934d-da040c34cce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.904984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-bc42b87f-5a75-4d3d-934d-da040c34cce2 None None] MFA Rules not processed for user `7e46af6e41bb45c08e5a6b9fd596e4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:05.906941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bc42b87f-5a75-4d3d-934d-da040c34cce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:05.915923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1272/2524] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Mar 31 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:19:05.927364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138ece-48f4-48e6-91ea-f0ec8094fe71 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:05.939510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138ece-48f4-48e6-91ea-f0ec8094fe71 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:05.943212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:05.943874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:05.944155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:05.944435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:05.954929 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:05.956384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:05.967429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1253/2525] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:09.889790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42b87f-5a75-4d3d-934d-da040c34cce2 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:09.902326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42b87f-5a75-4d3d-934d-da040c34cce2 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:09.909230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c8048-cce2-4389-9c24-3be19d235c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:09.910269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c8048-cce2-4389-9c24-3be19d235c2d service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:09.910807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c8048-cce2-4389-9c24-3be19d235c2d service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:09.911276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c8048-cce2-4389-9c24-3be19d235c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:09.913422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c68c8048-cce2-4389-9c24-3be19d235c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:09.928305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c8048-cce2-4389-9c24-3be19d235c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:09.930142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c8048-cce2-4389-9c24-3be19d235c2d service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:09.945536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1273/2526] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:10.685834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:10.687089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:10.700460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:10.700746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:10.701029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:10.722892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:10.724810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:10.767880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f828b70-d2d4-4684-b197-bfa0dcf7dab0 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:10.774868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:10.775804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:10.776089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:10.776367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] PATH_INFO: `/v3/users/88f265ced0f040c8b5c841ea0b6db513` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:10.779117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f265ced0f040c8b5c841ea0b6db513)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:10.781648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:10.786825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1274/2527] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:19:10.801922 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:10.803447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:10.881523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf361c-b5ae-4de7-a1e0-d492c6c872b8 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:10.888002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39403c9-6777-4707-a978-923b253aa5c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:10.888696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39403c9-6777-4707-a978-923b253aa5c5 service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:10.888975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39403c9-6777-4707-a978-923b253aa5c5 service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:10.889291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39403c9-6777-4707-a978-923b253aa5c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:10.898948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39403c9-6777-4707-a978-923b253aa5c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:10.900559 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39403c9-6777-4707-a978-923b253aa5c5 service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:10.911632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1275/2528] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:19:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 31 18:19:11.025555 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f265ced0f040c8b5c841ea0b6db513'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:11.100026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f265ced0f040c8b5c841ea0b6db513'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:11.122767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f265ced0f040c8b5c841ea0b6db513'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:11.123850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f265ced0f040c8b5c841ea0b6db513'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:11.124686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f265ced0f040c8b5c841ea0b6db513'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:11.155294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1254/2529] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:19:10 2022] DELETE /identity/v3/users/88f265ced0f040c8b5c841ea0b6db513 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:19:11.164254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:11.165977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:11.166489 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:11.188394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:11.191430 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:11.282644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1276/2530] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:19:11.297487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:11.299290 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:11.373099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cba56-488c-40fb-a85a-07e855cd2666 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:11.382890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:11.384820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:11.386308 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:11.388309 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:11.406433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:11.408369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:11.426967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1255/2531] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:11.967338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:11.973277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:11.983029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d204b-5708-45f0-968f-44b909ed39e5 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:11.988145 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:11.989202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:11.989657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:11.990081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] PATH_INFO: `/v3/projects/8a6ed0b44244485885a92dc64f293bba` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:11.991926 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6ed0b44244485885a92dc64f293bba)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:11.994110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:12.132285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6ed0b44244485885a92dc64f293bba', 'request_id': 'req-73575c43-3e00-41c6-8ea1-ba977f195012'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:12.138819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6ed0b44244485885a92dc64f293bba', 'request_id': 'req-73575c43-3e00-41c6-8ea1-ba977f195012'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:12.203406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6ed0b44244485885a92dc64f293bba', 'request_id': 'req-73575c43-3e00-41c6-8ea1-ba977f195012'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:12.218178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] The token cache is being invalidate because project 8a6ed0b44244485885a92dc64f293bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:19:12.218483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:12.219390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-73575c43-3e00-41c6-8ea1-ba977f195012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:19:12.220965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1277/2532] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:19:11 2022] DELETE /identity/v3/projects/8a6ed0b44244485885a92dc64f293bba => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:19:23.758917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:23.760408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:23.831682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e2883-fde6-4677-a064-60dbf05a8354 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:23.892764 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:23.893418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:23.893701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:23.893977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:23.895781 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:24.092258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:24.093798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:24.103211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1256/2533] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:33.463036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:33.463657 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:33.463771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:33.481282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] MFA Rules not processed for user `7c5ea90eba174068877cdcc1594ccda4`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:33.482453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:33.535279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1278/2534] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:19:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:19:42.226517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:42.227966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:42.242148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29351-d8c9-4b16-a881-30bd5d2ebeba service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:42.248124 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c8b29-4309-4179-9095-ee434469a433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:42.248757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c8b29-4309-4179-9095-ee434469a433 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:42.249033 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c8b29-4309-4179-9095-ee434469a433 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:42.249305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c8b29-4309-4179-9095-ee434469a433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:42.252967 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f96c8b29-4309-4179-9095-ee434469a433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:42.262999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c8b29-4309-4179-9095-ee434469a433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:42.264563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c8b29-4309-4179-9095-ee434469a433 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:42.274709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1257/2535] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:45.791471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:45.792868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:45.847764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966a22-07e9-4fc1-a34e-22654ddd0895 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:45.851323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:45.851970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:45.852245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:45.852516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:45.855018 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:45.914337 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:45.915843 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:45.925932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1279/2536] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:47.183456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:47.183456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:47.184190 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:47.201191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:47.202355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:47.259413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1258/2537] 10.222.0.58 () {58 vars in 967 bytes} [Thu Mar 31 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:19:47.283249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:47.285338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:47.362015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b45039-b75e-492f-8d94-3b265c47992f service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:47.367668 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abca9d6-3d86-4700-bf8d-d10ce2d63d8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:47.368484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abca9d6-3d86-4700-bf8d-d10ce2d63d8f service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:47.369369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abca9d6-3d86-4700-bf8d-d10ce2d63d8f service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:47.370429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abca9d6-3d86-4700-bf8d-d10ce2d63d8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:47.380759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abca9d6-3d86-4700-bf8d-d10ce2d63d8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:47.382461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abca9d6-3d86-4700-bf8d-d10ce2d63d8f service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:47.393436 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1280/2538] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:19:48.481487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:48.483965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:48.503431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5e01-6a18-43a1-b1e2-cf02da8375b4 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:48.510418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:48.511300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:48.511989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:48.512640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:48.515234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:48.530587 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:48.532908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:48.544339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1259/2539] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:19:54.649735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe04ae-516a-4ec9-971c-46dd1b8b9f65 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:54.650307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe04ae-516a-4ec9-971c-46dd1b8b9f65 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:54.650307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe04ae-516a-4ec9-971c-46dd1b8b9f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:54.667424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-17fe04ae-516a-4ec9-971c-46dd1b8b9f65 None None] MFA Rules not processed for user `d6a93e87d6894cfd9b7948274f1d7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:19:54.668669 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-17fe04ae-516a-4ec9-971c-46dd1b8b9f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:54.676573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1281/2540] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:19:57.430664 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:19:57.440883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de88d5-5258-4943-b7eb-356769b38e4b service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:19:57.444473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:19:57.445108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:19:57.445386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:19:57.445661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:19:57.447672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:19:57.513013 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:19:57.514430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:19:57.524090 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1260/2541] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:19:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:21:08.829301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51715b-5ce0-4a7a-9c35-d2702eb554ed None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:08.829840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51715b-5ce0-4a7a-9c35-d2702eb554ed None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:08.829840 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51715b-5ce0-4a7a-9c35-d2702eb554ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:08.848217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-9d51715b-5ce0-4a7a-9c35-d2702eb554ed None None] MFA Rules not processed for user `b1092332ac6040c597d28a4207c1ce86`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:21:08.849447 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9d51715b-5ce0-4a7a-9c35-d2702eb554ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:08.906322 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1282/2542] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:21:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:21:09.225241 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:09.226832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:09.237448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a22bd-b087-4c37-ac39-42290714e709 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:09.241937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:09.242561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:09.242898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:09.243171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:09.244905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:09.254869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:09.257188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:09.266916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1261/2543] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:21:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:21:29.546213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51715b-5ce0-4a7a-9c35-d2702eb554ed None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:29.555725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51715b-5ce0-4a7a-9c35-d2702eb554ed None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:29.559190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:29.559816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:29.560089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:29.560354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:29.562050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:29.621178 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:29.622585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:29.632597 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1283/2544] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:21:33.560025 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:33.561561 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:33.576118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b28a-7c49-4e33-b114-7c13d8481add service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:33.580541 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:33.581389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:33.581660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:33.581925 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] PATH_INFO: `/v3/users/d6a93e87d6894cfd9b7948274f1d7b70` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:33.583127 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a93e87d6894cfd9b7948274f1d7b70)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:33.585288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:33.765915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a93e87d6894cfd9b7948274f1d7b70'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:33.821183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a93e87d6894cfd9b7948274f1d7b70'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:33.833347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a93e87d6894cfd9b7948274f1d7b70'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:33.834019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a93e87d6894cfd9b7948274f1d7b70'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:33.834860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-88e528db-b5d4-420c-a403-6b5b261dbb84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a93e87d6894cfd9b7948274f1d7b70'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:33.846799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1262/2545] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:21:33 2022] DELETE /identity/v3/users/d6a93e87d6894cfd9b7948274f1d7b70 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:21:34.118928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:34.132150 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b4737-d8de-4d9c-98c1-cb286fe63fbf service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:34.189061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:34.189917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.190199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.190498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] PATH_INFO: `/v3/projects/6fc2eb72902a441ca6a6fa9350ce75f8` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.191691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc2eb72902a441ca6a6fa9350ce75f8)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:34.193747 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:34.300173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc2eb72902a441ca6a6fa9350ce75f8', 'request_id': 'req-041d56c7-2750-4cec-b578-11090493efc9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:34.305999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc2eb72902a441ca6a6fa9350ce75f8', 'request_id': 'req-041d56c7-2750-4cec-b578-11090493efc9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:34.384879 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc2eb72902a441ca6a6fa9350ce75f8', 'request_id': 'req-041d56c7-2750-4cec-b578-11090493efc9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:34.401003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] The token cache is being invalidate because project 6fc2eb72902a441ca6a6fa9350ce75f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:21:34.401488 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:34.402192 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-041d56c7-2750-4cec-b578-11090493efc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:21:34.403794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1284/2546] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:21:34 2022] DELETE /identity/v3/projects/6fc2eb72902a441ca6a6fa9350ce75f8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:21:34.409397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99935-e3bc-485f-9dce-1e6f39257a6a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.409744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99935-e3bc-485f-9dce-1e6f39257a6a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.410122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99935-e3bc-485f-9dce-1e6f39257a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.429831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-79c99935-e3bc-485f-9dce-1e6f39257a6a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:21:34.431151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-79c99935-e3bc-485f-9dce-1e6f39257a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:34.490051 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1263/2547] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:21:34.498059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ef0e-3813-4a9f-94e1-20e83347d054 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.498483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ef0e-3813-4a9f-94e1-20e83347d054 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.498766 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ef0e-3813-4a9f-94e1-20e83347d054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.518537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4dc5ef0e-3813-4a9f-94e1-20e83347d054 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:21:34.519757 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4dc5ef0e-3813-4a9f-94e1-20e83347d054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:34.528342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1285/2548] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:21:34.532701 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99935-e3bc-485f-9dce-1e6f39257a6a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:34.543798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99935-e3bc-485f-9dce-1e6f39257a6a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:34.548648 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:34.549355 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.549642 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.549915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.550682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:21:34.550990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:34.552575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:34.564044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1264/2549] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:21:34.568560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ef0e-3813-4a9f-94e1-20e83347d054 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:34.577937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ef0e-3813-4a9f-94e1-20e83347d054 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:34.582791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:34.583459 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.584304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.584560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.585319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:34.587339 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:34.708613 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1286/2550] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:21:34 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:21:34.713168 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:34.723439 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c657b-4096-491b-90e8-a0a5e09a5c07 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:34.777394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:34.778162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.778586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.778759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.779437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:34.781320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:34.930123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1265/2551] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:21:34 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:21:34.934383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:34.945115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a248a-5edf-4843-9b94-3b7779aa813a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:34.949603 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:34.950250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.950534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.950835 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.951552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:34.953157 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:34.963683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1287/2552] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:21:34.967525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:34.978192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acbc98-c683-4d52-b737-46e00bef0d82 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:34.983229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5c58-dbb5-4e57-8572-efe9dde1c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:34.989062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5c58-dbb5-4e57-8572-efe9dde1c759 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:34.989062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5c58-dbb5-4e57-8572-efe9dde1c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:34.989062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5c58-dbb5-4e57-8572-efe9dde1c759 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:34.989062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5c58-dbb5-4e57-8572-efe9dde1c759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:34.989062 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5c58-dbb5-4e57-8572-efe9dde1c759 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:34.998799 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1266/2553] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:21:35.003060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:35.015165 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba4124-3125-468f-bdae-e9597ed8caf1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:35.019989 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:35.020888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:35.021156 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:35.022290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] PATH_INFO: `/v3/projects/87baab8d37b040efbfe030d17be30823/users/c1a075de217449d9a941a7bc3c4c99c3/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:35.042360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87baab8d37b040efbfe030d17be30823, user_id=c1a075de217449d9a941a7bc3c4c99c3, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:35.045118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:35.152565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1288/2554] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:21:35 2022] PUT /identity/v3/projects/87baab8d37b040efbfe030d17be30823/users/c1a075de217449d9a941a7bc3c4c99c3/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:21:35.157661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ebeff-c23b-487f-b3fd-397e6ddbad1f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:35.157951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ebeff-c23b-487f-b3fd-397e6ddbad1f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:35.158229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ebeff-c23b-487f-b3fd-397e6ddbad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:35.176009 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-cd0ebeff-c23b-487f-b3fd-397e6ddbad1f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:21:35.177188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cd0ebeff-c23b-487f-b3fd-397e6ddbad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:35.234713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1267/2555] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:21:35.245180 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:35.247033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:35.304021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d8fa8-9d18-4204-b1d2-84887b3f342e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:35.307717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:35.308358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:35.308638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:35.308912 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:35.317908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:35.319571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:35.329282 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1289/2556] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:21:41.013104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171eff7-4de4-4447-87ae-87f95e54905c None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:41.013639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171eff7-4de4-4447-87ae-87f95e54905c None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:41.013639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171eff7-4de4-4447-87ae-87f95e54905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:41.042551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7171eff7-4de4-4447-87ae-87f95e54905c None None] MFA Rules not processed for user `c1a075de217449d9a941a7bc3c4c99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:21:41.043812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7171eff7-4de4-4447-87ae-87f95e54905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:41.115904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1268/2557] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:21:41.126963 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:41.128366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:41.203785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13350b3-3ab0-4846-92c9-765fd395e135 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:41.209764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:41.210417 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:41.210732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:41.211009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:41.219477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:41.221072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:41.230791 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1290/2558] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:21:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:21:43.645234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affca5-5c31-4c0c-9f9c-b505f29a17fb None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:43.645751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affca5-5c31-4c0c-9f9c-b505f29a17fb None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:43.645855 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affca5-5c31-4c0c-9f9c-b505f29a17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:43.663716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-95affca5-5c31-4c0c-9f9c-b505f29a17fb None None] MFA Rules not processed for user `c1a075de217449d9a941a7bc3c4c99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:21:43.665028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-95affca5-5c31-4c0c-9f9c-b505f29a17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:43.672772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1269/2559] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:21:50.050067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:21:50.051478 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:50.120104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6fa73-a013-457f-aa4e-4cf00c6c1658 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:21:50.125181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69777c82-feee-4752-9c93-a94950fd3262 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:21:50.125847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777c82-feee-4752-9c93-a94950fd3262 service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:21:50.126129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777c82-feee-4752-9c93-a94950fd3262 service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:21:50.126406 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777c82-feee-4752-9c93-a94950fd3262 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:21:50.128225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-69777c82-feee-4752-9c93-a94950fd3262 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:21:50.140461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69777c82-feee-4752-9c93-a94950fd3262 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:21:50.142062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69777c82-feee-4752-9c93-a94950fd3262 service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:21:50.152027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1291/2560] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:22:32.861968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:22:32.862915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:22:32.863359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:22:32.882221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] MFA Rules not processed for user `7c5ea90eba174068877cdcc1594ccda4`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:22:32.883652 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:22:32.947121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1270/2561] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:22:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:23:02.889263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d184c6-c8de-41b5-955b-b0d88751c988 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:02.889896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d184c6-c8de-41b5-955b-b0d88751c988 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:02.889896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d184c6-c8de-41b5-955b-b0d88751c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:02.909560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d6d184c6-c8de-41b5-955b-b0d88751c988 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:23:02.910807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d6d184c6-c8de-41b5-955b-b0d88751c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:23:02.970275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1292/2562] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:23:03.110216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:23:03.111779 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:23:03.183723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2afd-0083-4d05-b2cc-99e28e71bc0e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:23:03.188928 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:23:03.189650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:03.189936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:03.190208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:03.199626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:23:03.201204 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:23:03.211287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1271/2563] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:23:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:23:23.443026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826a2d-afef-410c-a641-d4b713679379 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:23.443493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826a2d-afef-410c-a641-d4b713679379 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:23.443593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826a2d-afef-410c-a641-d4b713679379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:23.461356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-44826a2d-afef-410c-a641-d4b713679379 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:23:23.462521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-44826a2d-afef-410c-a641-d4b713679379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:23:23.469790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1293/2564] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:23:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:23:23.481974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:23:23.492171 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b93e6-e38f-45ee-be37-47d86d7d2951 service swift] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:23:23.497809 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:23:23.498442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:23.499412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:23.499412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:23.507101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:23:23.508651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:23:23.516817 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1272/2565] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:23:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:23:43.219970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44826a2d-afef-410c-a641-d4b713679379 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:23:43.229640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44826a2d-afef-410c-a641-d4b713679379 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:23:43.234558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e8946-c985-491a-8e00-51225914def1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:23:43.235288 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8946-c985-491a-8e00-51225914def1 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:43.235632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8946-c985-491a-8e00-51225914def1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:43.235970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8946-c985-491a-8e00-51225914def1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:43.237776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-675e8946-c985-491a-8e00-51225914def1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:23:43.251632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e8946-c985-491a-8e00-51225914def1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:23:43.253049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e8946-c985-491a-8e00-51225914def1 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:23:43.264641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1294/2566] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:23:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:23:44.468352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:23:44.469866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:23:44.483684 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366b17-b57f-4b70-846e-e1070e0c65c1 service swift] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:23:44.488269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:23:44.488927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:44.489205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:44.489609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:44.491568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:23:44.505916 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:23:44.507345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:23:44.518761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1273/2567] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:23:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:23:45.457174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff9c16-7bf9-4e39-9f3f-860d0cc43f58 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:45.457636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff9c16-7bf9-4e39-9f3f-860d0cc43f58 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:45.457745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff9c16-7bf9-4e39-9f3f-860d0cc43f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:45.477362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d0ff9c16-7bf9-4e39-9f3f-860d0cc43f58 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:23:45.478571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d0ff9c16-7bf9-4e39-9f3f-860d0cc43f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:23:45.486525 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1295/2568] 10.222.0.58 () {58 vars in 967 bytes} [Thu Mar 31 18:23:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:23:45.498476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:23:45.509389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc79ad-2286-42b5-b805-52ee8b0bd0a6 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:23:45.514507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:23:45.515174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:23:45.515452 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:23:45.515725 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:23:45.523635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:23:45.525217 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:23:45.534486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1274/2569] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:23:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:24:03.941170 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff9c16-7bf9-4e39-9f3f-860d0cc43f58 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:03.950706 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff9c16-7bf9-4e39-9f3f-860d0cc43f58 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:03.954464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:03.955137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:03.955414 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:03.955688 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:03.957467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:03.967335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:03.969097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:03.978146 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1296/2570] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:24:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:24:28.212405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:28.222379 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8973a-cc43-44e5-8607-dfe5312bf7ef service swift] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:28.226016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:28.226738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:28.227003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:28.227279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:28.229115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:28.285654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:28.287101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:28.296457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1275/2571] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:24:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:24:29.249978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:29.251402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:29.269812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e1a6-0cd3-4a71-aaec-73f0a8108cae service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:29.275704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:29.276460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:29.276812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:29.277169 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:29.279131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:29.292557 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:29.294981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:29.306190 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1297/2572] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:24:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:24:34.743091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:34.752846 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c794-691f-4731-ad6c-4705f2eb49ae service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:34.756448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:34.757089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:34.757373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:34.757651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:34.759560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:34.771511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:34.772911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:34.782795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1276/2573] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:24:42.044849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:42.050487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:42.062034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c1b0b-9b5f-4827-bc8e-bd9a244f5436 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:42.066959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:42.067822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:42.068105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:42.068405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] PATH_INFO: `/v3/users/6f1d5c7f14e2491aa217a7d2939fe962` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:42.069590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1d5c7f14e2491aa217a7d2939fe962)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:42.071746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:42.239955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1d5c7f14e2491aa217a7d2939fe962'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.240601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1d5c7f14e2491aa217a7d2939fe962'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.247188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1d5c7f14e2491aa217a7d2939fe962'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.318453 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1d5c7f14e2491aa217a7d2939fe962'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.319009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1d5c7f14e2491aa217a7d2939fe962'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.337679 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1298/2574] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:24:42 2022] DELETE /identity/v3/users/6f1d5c7f14e2491aa217a7d2939fe962 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:24:42.600531 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:42.610759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416b044-46ed-47be-a81f-57ed70b19f55 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:42.669738 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:42.670946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:42.671231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:42.671654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] PATH_INFO: `/v3/projects/10c09876736547b59f4bb56fa5740f5f` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:42.672887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c09876736547b59f4bb56fa5740f5f)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:42.674816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:42.797333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c09876736547b59f4bb56fa5740f5f', 'request_id': 'req-95b9884d-8c93-4619-ae14-b24645313a77'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.855618 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c09876736547b59f4bb56fa5740f5f', 'request_id': 'req-95b9884d-8c93-4619-ae14-b24645313a77'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.861960 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c09876736547b59f4bb56fa5740f5f', 'request_id': 'req-95b9884d-8c93-4619-ae14-b24645313a77'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.873023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] The token cache is being invalidate because project 10c09876736547b59f4bb56fa5740f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:24:42.873284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.873896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:42.876086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1277/2575] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:24:42 2022] DELETE /identity/v3/projects/10c09876736547b59f4bb56fa5740f5f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:24:42.880098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:42.881618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:42.897474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb873cc-3faa-40d3-865e-d789f77000f3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:42.956167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:42.957035 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:42.957316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:42.957592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] PATH_INFO: `/v3/users/875eead6ee1a49b6a35d0affe7696b8a` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:42.958815 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=875eead6ee1a49b6a35d0affe7696b8a)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:42.960722 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:43.160868 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875eead6ee1a49b6a35d0affe7696b8a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.161516 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875eead6ee1a49b6a35d0affe7696b8a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.168179 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875eead6ee1a49b6a35d0affe7696b8a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.233037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875eead6ee1a49b6a35d0affe7696b8a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.234463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875eead6ee1a49b6a35d0affe7696b8a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.255614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1299/2576] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:24:42 2022] DELETE /identity/v3/users/875eead6ee1a49b6a35d0affe7696b8a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:24:43.537937 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:43.539387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:43.552475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9884d-8c93-4619-ae14-b24645313a77 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:43.611145 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:43.612015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:43.612294 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:43.612588 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] PATH_INFO: `/v3/projects/852d16fa9ffc499280fca9e91b225101` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:43.613797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=852d16fa9ffc499280fca9e91b225101)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:43.615710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:43.720395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852d16fa9ffc499280fca9e91b225101', 'request_id': 'req-348822c0-580a-4a6b-8a75-a71b93e6a1ef'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.786780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852d16fa9ffc499280fca9e91b225101', 'request_id': 'req-348822c0-580a-4a6b-8a75-a71b93e6a1ef'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.792337 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852d16fa9ffc499280fca9e91b225101', 'request_id': 'req-348822c0-580a-4a6b-8a75-a71b93e6a1ef'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.803550 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] The token cache is being invalidate because project 852d16fa9ffc499280fca9e91b225101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:24:43.803869 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.804579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:24:43.806249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1278/2577] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:24:43 2022] DELETE /identity/v3/projects/852d16fa9ffc499280fca9e91b225101 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:24:50.875902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:24:50.877310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:50.933801 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362912e3-6553-48fc-990e-d243897fbea7 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:24:50.979865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:24:50.987343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:24:50.987343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:24:50.987343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:24:50.987343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:24:51.063671 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:24:51.064483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:24:51.082994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1300/2578] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:24:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:25:01.037547 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:01.038981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:01.099250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348822c0-580a-4a6b-8a75-a71b93e6a1ef admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:01.102917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:01.103564 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:01.103840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:01.104113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:01.105874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:01.167985 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:01.169323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:01.178958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1279/2579] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:25:05.125683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:05.127298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:05.141925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051af87-68f1-4740-9e4a-926bd4ec84fe service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:05.146916 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:05.147808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:05.148088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:05.148358 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] PATH_INFO: `/v3/users/b1092332ac6040c597d28a4207c1ce86` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:05.150015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1092332ac6040c597d28a4207c1ce86)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:05.151983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:05.302555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1092332ac6040c597d28a4207c1ce86'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.303233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1092332ac6040c597d28a4207c1ce86'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.309885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1092332ac6040c597d28a4207c1ce86'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.364371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1092332ac6040c597d28a4207c1ce86'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.364942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-0799b8f8-2196-4615-85ca-8d8ff707094a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1092332ac6040c597d28a4207c1ce86'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.383466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1301/2580] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:25:05 2022] DELETE /identity/v3/users/b1092332ac6040c597d28a4207c1ce86 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:25:05.630117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:05.646586 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924604-0c63-49db-b725-0181abfdf163 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:05.706482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:05.707418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:05.707700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:05.707969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] PATH_INFO: `/v3/projects/eb7248f2c93342cd823f385c53a69d05` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:05.709152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7248f2c93342cd823f385c53a69d05)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:05.711113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:05.831887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7248f2c93342cd823f385c53a69d05', 'request_id': 'req-fcfc5e59-c2d1-4678-99be-bf072eb86b12'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.905767 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7248f2c93342cd823f385c53a69d05', 'request_id': 'req-fcfc5e59-c2d1-4678-99be-bf072eb86b12'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.911575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7248f2c93342cd823f385c53a69d05', 'request_id': 'req-fcfc5e59-c2d1-4678-99be-bf072eb86b12'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.922933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] The token cache is being invalidate because project eb7248f2c93342cd823f385c53a69d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:25:05.928240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.928240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fcfc5e59-c2d1-4678-99be-bf072eb86b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:25:05.928240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1280/2581] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:25:05 2022] DELETE /identity/v3/projects/eb7248f2c93342cd823f385c53a69d05 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:25:05.930412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2cc8-ed83-47ec-97e4-afef947956f7 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:05.930741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2cc8-ed83-47ec-97e4-afef947956f7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:05.931017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2cc8-ed83-47ec-97e4-afef947956f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:05.949351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2d0e2cc8-ed83-47ec-97e4-afef947956f7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:25:05.950530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2d0e2cc8-ed83-47ec-97e4-afef947956f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:06.014060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1302/2582] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:25:06.022988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab264c-13bb-4a88-8cbd-85adf07b9538 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.023271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab264c-13bb-4a88-8cbd-85adf07b9538 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.023573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab264c-13bb-4a88-8cbd-85adf07b9538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.044973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0bab264c-13bb-4a88-8cbd-85adf07b9538 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:25:06.046185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0bab264c-13bb-4a88-8cbd-85adf07b9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:06.058650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1281/2583] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:25:06.060692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2cc8-ed83-47ec-97e4-afef947956f7 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:06.075243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2cc8-ed83-47ec-97e4-afef947956f7 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:06.087937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:06.089048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.089577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.089950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.091240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:25:06.091740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:06.096079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:06.124117 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1303/2584] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:25:06.128577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab264c-13bb-4a88-8cbd-85adf07b9538 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:06.138822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab264c-13bb-4a88-8cbd-85adf07b9538 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:06.144598 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:06.145432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.145749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.146208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.147104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:06.149283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:06.349747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1282/2585] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:25:06 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:25:06.354580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:06.366786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ec438-b77e-4dd4-b5fb-27059b03f253 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:06.438644 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:06.439439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.439729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.440013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.440742 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:06.442707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:06.612181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1304/2586] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:25:06 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:25:06.618120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:06.630179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5032e-13c5-4ce9-829a-20b8043452f8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:06.634959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:06.635639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.635974 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.636186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.637023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:06.638927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:06.651287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1283/2587] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:25:06.656382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:06.668313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ce82c-5ee3-4790-87b2-c6713e74b7b0 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:06.677397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88274a2-9c6a-4a5f-83c7-4fb1cdb0d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:06.678080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88274a2-9c6a-4a5f-83c7-4fb1cdb0d6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.678368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88274a2-9c6a-4a5f-83c7-4fb1cdb0d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.678703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88274a2-9c6a-4a5f-83c7-4fb1cdb0d6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.679464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88274a2-9c6a-4a5f-83c7-4fb1cdb0d6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:06.681130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88274a2-9c6a-4a5f-83c7-4fb1cdb0d6e3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:06.693279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1305/2588] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:25:06.698030 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:06.710099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a72b9-6450-47c7-8b20-8dc4d336cff6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:06.717056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:06.719055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.719737 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.720162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] PATH_INFO: `/v3/projects/7ae2325a87da4c5f8179a77fbd3d8748/users/211572ee7ab5422981422eaed6341657/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.738039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae2325a87da4c5f8179a77fbd3d8748, user_id=211572ee7ab5422981422eaed6341657, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:06.742078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:06.854581 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1284/2589] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:25:06 2022] PUT /identity/v3/projects/7ae2325a87da4c5f8179a77fbd3d8748/users/211572ee7ab5422981422eaed6341657/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:25:06.860744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95939079-cf31-4651-a1b0-03c186811a16 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:06.861201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95939079-cf31-4651-a1b0-03c186811a16 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:06.861541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95939079-cf31-4651-a1b0-03c186811a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:06.885904 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-95939079-cf31-4651-a1b0-03c186811a16 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:25:06.888482 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-95939079-cf31-4651-a1b0-03c186811a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:06.952859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1306/2590] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:25:06.963102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:06.964830 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:07.033126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561b979-c4b1-4d9b-b17d-9778053e87ec admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:07.036793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:07.037443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:07.037726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:07.038001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:07.047998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:07.049420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:07.059504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1285/2591] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:25:13.209862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:13.210374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:13.210654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:13.240741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] MFA Rules not processed for user `211572ee7ab5422981422eaed6341657`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:25:13.242790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:13.333383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1307/2592] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:25:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:25:13.345949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:13.347576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:13.433173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac3e3f-b0bd-4176-9940-043b46cbfdc1 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:13.440277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e4620-dc33-462c-af7e-aee60e9547bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:13.440951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4620-dc33-462c-af7e-aee60e9547bd service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:13.441239 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4620-dc33-462c-af7e-aee60e9547bd service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:13.441533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4620-dc33-462c-af7e-aee60e9547bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:13.450408 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e4620-dc33-462c-af7e-aee60e9547bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:13.452249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e4620-dc33-462c-af7e-aee60e9547bd service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:13.463253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1286/2593] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:25:14.427043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:14.428541 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:14.496208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15c23-5815-4e38-9406-a1ed47e9a09a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:14.502086 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:14.502790 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:14.503077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:14.503457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:14.505628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:14.582301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:14.585335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:14.598601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1308/2594] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:25:16.758219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092d2c5-cb58-4953-adf0-9ffc0cca9a98 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:16.758958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092d2c5-cb58-4953-adf0-9ffc0cca9a98 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:16.758958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092d2c5-cb58-4953-adf0-9ffc0cca9a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:16.777669 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d092d2c5-cb58-4953-adf0-9ffc0cca9a98 None None] MFA Rules not processed for user `211572ee7ab5422981422eaed6341657`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:25:16.778895 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d092d2c5-cb58-4953-adf0-9ffc0cca9a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:16.795347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1287/2595] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:25:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:25:18.671807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:18.673424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:18.743908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5d9d-1aa7-472b-8e1c-4e4f1f3e2d34 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:18.749012 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:18.750217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:18.750710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:18.750983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:18.752808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:18.767687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:18.769276 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:18.780019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1309/2596] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:25:27.570751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:27.571301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:27.571429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:27.589406 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] MFA Rules not processed for user `7c5ea90eba174068877cdcc1594ccda4`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:25:27.590745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:27.597963 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1288/2597] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:25:33.821342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:33.833381 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb28ed-6160-443b-b5a9-83bd5c7de5f4 service placement] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:33.838724 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:33.839355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:33.839637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:33.839908 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:33.841655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:33.853874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:33.855451 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:33.866748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1310/2598] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:25:38.600261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:38.601803 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:38.618977 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcd222-e3e4-4f6c-a570-f9db5f1b98f3 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:38.624822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:38.625493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:38.625769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:38.626046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:38.627951 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:38.641704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:38.643382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:38.654976 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1289/2599] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:25:50.102419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:25:50.138151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d8bd-364f-4c05-84f1-06a6d2565ff6 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:25:50.142307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b97ea-09a1-4f6d-a645-a8d5f3ce9641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:25:50.142979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b97ea-09a1-4f6d-a645-a8d5f3ce9641 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:25:50.143258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b97ea-09a1-4f6d-a645-a8d5f3ce9641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:25:50.143532 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b97ea-09a1-4f6d-a645-a8d5f3ce9641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:25:50.145279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-aa3b97ea-09a1-4f6d-a645-a8d5f3ce9641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:25:50.235807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b97ea-09a1-4f6d-a645-a8d5f3ce9641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:25:50.237226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b97ea-09a1-4f6d-a645-a8d5f3ce9641 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:25:50.247309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1311/2600] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:25:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:26:43.796912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:26:43.798321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:26:43.858942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437563c3-f2fd-46c2-ab23-3107e21252f4 service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:26:43.863369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:26:43.864089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:26:43.864373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:26:43.864644 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:26:43.866391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:26:43.925636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:26:43.927195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:26:43.936082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1290/2601] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:26:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:26:53.790403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272e24-1fee-4324-8de4-4c7b3c50fa48 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:26:53.790979 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272e24-1fee-4324-8de4-4c7b3c50fa48 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:26:53.791079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272e24-1fee-4324-8de4-4c7b3c50fa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:26:53.808553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-68272e24-1fee-4324-8de4-4c7b3c50fa48 None None] MFA Rules not processed for user `c1a075de217449d9a941a7bc3c4c99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:26:53.810888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-68272e24-1fee-4324-8de4-4c7b3c50fa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:26:53.817329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1312/2602] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:26:54.125397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:26:54.126848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:26:54.151739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8298-bedc-45fd-955f-27dba2ab48d4 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:26:54.155224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777aac7-ec7c-478a-9425-516a391b5313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:26:54.155860 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777aac7-ec7c-478a-9425-516a391b5313 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:26:54.156139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777aac7-ec7c-478a-9425-516a391b5313 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:26:54.156410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777aac7-ec7c-478a-9425-516a391b5313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:26:54.158213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a777aac7-ec7c-478a-9425-516a391b5313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:26:54.170831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777aac7-ec7c-478a-9425-516a391b5313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:26:54.172299 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777aac7-ec7c-478a-9425-516a391b5313 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:26:54.180571 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1291/2603] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:26:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:26:55.894529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68272e24-1fee-4324-8de4-4c7b3c50fa48 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:26:55.916977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68272e24-1fee-4324-8de4-4c7b3c50fa48 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:26:55.921892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:26:55.922522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:26:55.922826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:26:55.923127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:26:55.924901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:26:55.948714 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:26:55.950269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:26:55.960710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1313/2604] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:27:15.606500 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4e4d-7dc4-4f53-a55a-0ade16e54888 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:27:15.607103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4e4d-7dc4-4f53-a55a-0ade16e54888 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:27:15.607259 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4e4d-7dc4-4f53-a55a-0ade16e54888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:27:15.625932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-26fd4e4d-7dc4-4f53-a55a-0ade16e54888 None None] MFA Rules not processed for user `211572ee7ab5422981422eaed6341657`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:27:15.627265 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-26fd4e4d-7dc4-4f53-a55a-0ade16e54888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:27:15.634067 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1292/2605] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:27:15.933280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:27:15.942984 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c0e2-7d7e-476c-9c2a-5639d5fba646 service placement] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:27:15.946629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:27:15.947275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:27:15.947560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:27:15.947834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:27:15.949625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:27:15.960402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:27:15.961814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:27:15.969717 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1314/2606] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:27:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:28:10.833626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4e4d-7dc4-4f53-a55a-0ade16e54888 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:28:10.843516 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4e4d-7dc4-4f53-a55a-0ade16e54888 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:28:10.847065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:28:10.847706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:28:10.847988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:28:10.848262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:28:10.850088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:10.893434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:28:10.893434 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:28:10.908818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1293/2607] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:28:18.788641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:28:18.792535 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:18.805707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62996801-52d4-419d-a72c-f678edd9989e service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:28:18.810570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:28:18.811399 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:28:18.811676 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:28:18.811940 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] PATH_INFO: `/v3/users/7c5ea90eba174068877cdcc1594ccda4` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:28:18.813125 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5ea90eba174068877cdcc1594ccda4)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:28:18.815100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:28:19.000205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5ea90eba174068877cdcc1594ccda4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.000875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5ea90eba174068877cdcc1594ccda4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.007849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5ea90eba174068877cdcc1594ccda4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.102507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5ea90eba174068877cdcc1594ccda4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.103181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5ea90eba174068877cdcc1594ccda4'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.121010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1315/2608] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:28:18 2022] DELETE /identity/v3/users/7c5ea90eba174068877cdcc1594ccda4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:28:19.384632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:28:19.396577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe959f-0e93-44a2-a45b-17c12a693987 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:28:19.458899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:28:19.459751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:28:19.460042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:28:19.460306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] PATH_INFO: `/v3/projects/70f0b3390f4542c8831753ecf26f6745` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:28:19.462123 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f0b3390f4542c8831753ecf26f6745)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:28:19.464043 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:28:19.592777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f0b3390f4542c8831753ecf26f6745', 'request_id': 'req-495c418a-9221-4053-83d5-d837dce2e349'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.702084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f0b3390f4542c8831753ecf26f6745', 'request_id': 'req-495c418a-9221-4053-83d5-d837dce2e349'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.707633 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f0b3390f4542c8831753ecf26f6745', 'request_id': 'req-495c418a-9221-4053-83d5-d837dce2e349'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.718891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] The token cache is being invalidate because project 70f0b3390f4542c8831753ecf26f6745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:28:19.719176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.719800 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:19.721321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1294/2609] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:28:19 2022] DELETE /identity/v3/projects/70f0b3390f4542c8831753ecf26f6745 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:28:19.725441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:28:19.727009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:19.739844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfdc99-8974-457d-aa46-a7559cdcfb68 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:28:19.795155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:28:19.796014 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:28:19.796294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:28:19.796568 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] PATH_INFO: `/v3/users/e0183fefb5d74782bba4b90745a6dc50` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:28:19.797750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0183fefb5d74782bba4b90745a6dc50)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:28:19.799705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:28:20.029072 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0183fefb5d74782bba4b90745a6dc50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.029736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0183fefb5d74782bba4b90745a6dc50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.036422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0183fefb5d74782bba4b90745a6dc50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.130261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0183fefb5d74782bba4b90745a6dc50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.130995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0183fefb5d74782bba4b90745a6dc50'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.149239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1316/2610] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:28:19 2022] DELETE /identity/v3/users/e0183fefb5d74782bba4b90745a6dc50 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:28:20.406175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:28:20.416276 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:20.421352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c418a-9221-4053-83d5-d837dce2e349 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:28:20.477600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:28:20.478450 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:28:20.478763 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:28:20.479034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] PATH_INFO: `/v3/projects/925b9541efdf4ed084c2a62b9434089e` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:28:20.480221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925b9541efdf4ed084c2a62b9434089e)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:28:20.482086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:28:20.615546 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925b9541efdf4ed084c2a62b9434089e', 'request_id': 'req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.707605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925b9541efdf4ed084c2a62b9434089e', 'request_id': 'req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.714049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925b9541efdf4ed084c2a62b9434089e', 'request_id': 'req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.725000 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] The token cache is being invalidate because project 925b9541efdf4ed084c2a62b9434089e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:28:20.725284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.725915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:28:20.727559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1295/2611] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:28:20 2022] DELETE /identity/v3/projects/925b9541efdf4ed084c2a62b9434089e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:28:53.005285 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:28:53.006784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:53.062287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c89f8d-f596-4f90-a285-4a03a1187e4f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:28:53.108750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297e1f-cc14-4ca1-b682-0498c6848ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:28:53.109400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297e1f-cc14-4ca1-b682-0498c6848ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:28:53.109681 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297e1f-cc14-4ca1-b682-0498c6848ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:28:53.109977 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297e1f-cc14-4ca1-b682-0498c6848ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:28:53.111830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-09297e1f-cc14-4ca1-b682-0498c6848ce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:53.199518 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297e1f-cc14-4ca1-b682-0498c6848ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:28:53.200933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297e1f-cc14-4ca1-b682-0498c6848ce7 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:28:53.220544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1317/2612] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:28:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:28:59.015883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:28:59.017300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:59.074327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf9ec8-8bb8-4f00-9130-40c3ab343c67 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:28:59.077881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:28:59.078567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:28:59.078880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:28:59.079151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:28:59.080894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:28:59.094279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:28:59.095770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:28:59.106971 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1296/2613] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:14.841065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc02a-1e6b-43ee-9a92-7021454c252c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:14.841614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc02a-1e6b-43ee-9a92-7021454c252c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:14.841614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc02a-1e6b-43ee-9a92-7021454c252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:14.858865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-feabc02a-1e6b-43ee-9a92-7021454c252c None None] MFA Rules not processed for user `211572ee7ab5422981422eaed6341657`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:14.860077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-feabc02a-1e6b-43ee-9a92-7021454c252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:14.916888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1318/2614] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:18.534667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:18.536176 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:18.548151 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9dbf1-3fc3-4e58-a06a-d3f23285d489 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:18.554109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:18.554883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:18.555170 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:18.559804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:18.559804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:18.568629 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:18.570293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:18.582377 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1297/2615] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:19.085444 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc02a-1e6b-43ee-9a92-7021454c252c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:19.095772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc02a-1e6b-43ee-9a92-7021454c252c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:19.099594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:19.100245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:19.100529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:19.100863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:19.102645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:19.169123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:19.170750 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:19.181586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1319/2616] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:29:23.678837 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:23.680878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:23.698421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f18b-7801-4b50-96ed-536836071bc3 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:23.703808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:23.704706 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:23.704989 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:23.705333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] PATH_INFO: `/v3/users/c1a075de217449d9a941a7bc3c4c99c3` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:23.706489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a075de217449d9a941a7bc3c4c99c3)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:23.708584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:23.961589 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a075de217449d9a941a7bc3c4c99c3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.057483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a075de217449d9a941a7bc3c4c99c3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.070674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a075de217449d9a941a7bc3c4c99c3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.071431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a075de217449d9a941a7bc3c4c99c3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.072029 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bbe2697a-9546-4de4-a42d-96846ce8460b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a075de217449d9a941a7bc3c4c99c3'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.084070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1298/2617] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:29:23 2022] DELETE /identity/v3/users/c1a075de217449d9a941a7bc3c4c99c3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:24.321594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:24.331719 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92229-a5c7-4618-8674-17fee36a143f service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:24.387487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:24.388413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:24.388692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:24.388966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] PATH_INFO: `/v3/projects/87baab8d37b040efbfe030d17be30823` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:24.390131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87baab8d37b040efbfe030d17be30823)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:24.392045 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:24.497618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87baab8d37b040efbfe030d17be30823', 'request_id': 'req-ec2d4344-942b-4255-a9d3-6db7f15a837a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.503223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87baab8d37b040efbfe030d17be30823', 'request_id': 'req-ec2d4344-942b-4255-a9d3-6db7f15a837a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.582885 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87baab8d37b040efbfe030d17be30823', 'request_id': 'req-ec2d4344-942b-4255-a9d3-6db7f15a837a'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.594721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] The token cache is being invalidate because project 87baab8d37b040efbfe030d17be30823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:29:24.595011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.595634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec2d4344-942b-4255-a9d3-6db7f15a837a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:24.597155 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1320/2618] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:29:24 2022] DELETE /identity/v3/projects/87baab8d37b040efbfe030d17be30823 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:29:24.601961 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365dbd7-4134-4e4e-8b32-9a60db2b1f54 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:24.602248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365dbd7-4134-4e4e-8b32-9a60db2b1f54 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:24.602519 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365dbd7-4134-4e4e-8b32-9a60db2b1f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:24.657284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e365dbd7-4134-4e4e-8b32-9a60db2b1f54 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:24.658474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e365dbd7-4134-4e4e-8b32-9a60db2b1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:24.724228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1299/2619] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:24.725463 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21392809-f079-400b-95fc-329424cead91 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:24.725748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21392809-f079-400b-95fc-329424cead91 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:24.726029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21392809-f079-400b-95fc-329424cead91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:24.744896 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-21392809-f079-400b-95fc-329424cead91 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:24.746199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-21392809-f079-400b-95fc-329424cead91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:24.754403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1321/2620] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:24.759075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365dbd7-4134-4e4e-8b32-9a60db2b1f54 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:24.770941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365dbd7-4134-4e4e-8b32-9a60db2b1f54 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:24.778414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:24.779729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:24.780007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:24.780279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:24.781064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:29:24.781367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:24.783193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:24.795978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1300/2621] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:29:24.800248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21392809-f079-400b-95fc-329424cead91 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:24.809458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21392809-f079-400b-95fc-329424cead91 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:24.814365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:24.815052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:24.815333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:24.815608 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:24.816307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:24.818186 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:24.933920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1322/2622] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:24 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:29:24.938368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:24.948209 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a9134-839b-4c29-aac9-08c3cff85cd6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:25.007485 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:25.008260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:25.008606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:25.008945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:25.009699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:25.011815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:25.126810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1301/2623] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:24 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:29:25.130776 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:25.142030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16120-e22c-4f36-8ec9-e1773749baa3 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:25.146806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:25.147464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:25.147765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:25.148057 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:25.149028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:25.150576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:25.160967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1323/2624] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:25.168021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:25.178200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095e25-9d33-4acd-8231-55646cfb45c9 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:25.182820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b24603-aa96-44d0-9386-c5f0dbd30984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:25.183478 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24603-aa96-44d0-9386-c5f0dbd30984 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:25.183762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24603-aa96-44d0-9386-c5f0dbd30984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:25.184041 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24603-aa96-44d0-9386-c5f0dbd30984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:25.185383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b24603-aa96-44d0-9386-c5f0dbd30984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:25.187108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b24603-aa96-44d0-9386-c5f0dbd30984 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:25.196721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1302/2625] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:25.201308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:25.211227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc65b3-9bab-4334-a626-8c980f6fbec9 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:25.215692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:25.216755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:25.217129 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:25.217404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] PATH_INFO: `/v3/projects/1d169639327c441fbe2e0a526ef96ee9/users/aa84bc13bab849e08d3e73c7aec8b6ad/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:25.231327 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d169639327c441fbe2e0a526ef96ee9, user_id=aa84bc13bab849e08d3e73c7aec8b6ad, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:25.234743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:25.383207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1324/2626] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:25 2022] PUT /identity/v3/projects/1d169639327c441fbe2e0a526ef96ee9/users/aa84bc13bab849e08d3e73c7aec8b6ad/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:25.393609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f605f5-f51c-42a7-a5ea-af7c702cadc8 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:25.393899 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f605f5-f51c-42a7-a5ea-af7c702cadc8 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:25.394184 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f605f5-f51c-42a7-a5ea-af7c702cadc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:25.421874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-e8f605f5-f51c-42a7-a5ea-af7c702cadc8 None None] MFA Rules not processed for user `aa84bc13bab849e08d3e73c7aec8b6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:25.423088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e8f605f5-f51c-42a7-a5ea-af7c702cadc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:25.484573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1303/2627] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:25.495167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:25.497048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:25.558639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7a000-1614-4c6f-a913-4a732dc66f7c admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:25.563134 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62379eb-a60f-43f5-9de7-85fc367acd91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:25.563787 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62379eb-a60f-43f5-9de7-85fc367acd91 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:25.564092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62379eb-a60f-43f5-9de7-85fc367acd91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:25.564371 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62379eb-a60f-43f5-9de7-85fc367acd91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:25.572910 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62379eb-a60f-43f5-9de7-85fc367acd91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:25.574402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62379eb-a60f-43f5-9de7-85fc367acd91 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:25.583480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1325/2628] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:37.877107 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f605f5-f51c-42a7-a5ea-af7c702cadc8 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:37.936397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f605f5-f51c-42a7-a5ea-af7c702cadc8 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:37.940863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:37.941721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:37.942001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:37.942275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] PATH_INFO: `/v3/users/aa84bc13bab849e08d3e73c7aec8b6ad` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:37.943560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa84bc13bab849e08d3e73c7aec8b6ad)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:37.945459 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:38.144789 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa84bc13bab849e08d3e73c7aec8b6ad'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:38.314472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa84bc13bab849e08d3e73c7aec8b6ad'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:38.327752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa84bc13bab849e08d3e73c7aec8b6ad'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:38.328410 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa84bc13bab849e08d3e73c7aec8b6ad'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:38.329040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa84bc13bab849e08d3e73c7aec8b6ad'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:38.340613 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1304/2629] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:29:37 2022] DELETE /identity/v3/users/aa84bc13bab849e08d3e73c7aec8b6ad => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:38.345259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:38.345729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:38.345848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:38.363033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:38.364218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:38.422410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1326/2630] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:38.431798 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:38.433197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:38.488930 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c68-0f43-4468-ab5f-4887d7290eee admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:38.492482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcabb1c-1f23-482b-9c68-b44fa06cc253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:38.493121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcabb1c-1f23-482b-9c68-b44fa06cc253 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:38.493402 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcabb1c-1f23-482b-9c68-b44fa06cc253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:38.493674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcabb1c-1f23-482b-9c68-b44fa06cc253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:38.503154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcabb1c-1f23-482b-9c68-b44fa06cc253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:38.504672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcabb1c-1f23-482b-9c68-b44fa06cc253 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:38.513947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1305/2631] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:38.943320 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:38.944818 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:38.957999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297460e0-d461-4a47-95ab-cacbfb7d0f90 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:38.962586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:38.963477 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:38.963759 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:38.964031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] PATH_INFO: `/v3/projects/1d169639327c441fbe2e0a526ef96ee9` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:38.965261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d169639327c441fbe2e0a526ef96ee9)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:38.967966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.120584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d169639327c441fbe2e0a526ef96ee9', 'request_id': 'req-e45760ca-6e49-4792-bbb3-0c44679d924e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:39.126108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d169639327c441fbe2e0a526ef96ee9', 'request_id': 'req-e45760ca-6e49-4792-bbb3-0c44679d924e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:39.198819 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d169639327c441fbe2e0a526ef96ee9', 'request_id': 'req-e45760ca-6e49-4792-bbb3-0c44679d924e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:39.210551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] The token cache is being invalidate because project 1d169639327c441fbe2e0a526ef96ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:29:39.210799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:39.211422 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-e45760ca-6e49-4792-bbb3-0c44679d924e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:39.212936 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1327/2632] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:29:38 2022] DELETE /identity/v3/projects/1d169639327c441fbe2e0a526ef96ee9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:39.218620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bad26-f4ed-42ec-b6c6-a0266f131097 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.219087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bad26-f4ed-42ec-b6c6-a0266f131097 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.219198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bad26-f4ed-42ec-b6c6-a0266f131097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.236749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-d63bad26-f4ed-42ec-b6c6-a0266f131097 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:39.237927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d63bad26-f4ed-42ec-b6c6-a0266f131097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:39.296957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1306/2633] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:39.304890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f430-dc50-4d64-9e9f-23474a22b9a8 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.305287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f430-dc50-4d64-9e9f-23474a22b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.305572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f430-dc50-4d64-9e9f-23474a22b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.324181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ee72f430-dc50-4d64-9e9f-23474a22b9a8 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:39.325368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ee72f430-dc50-4d64-9e9f-23474a22b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:39.333411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1328/2634] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:39.337522 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bad26-f4ed-42ec-b6c6-a0266f131097 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:39.346880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bad26-f4ed-42ec-b6c6-a0266f131097 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:39.351370 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:39.352042 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.352320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.352590 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.353297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:29:39.353666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:39.355186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.366814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1307/2635] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:29:39.370874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f430-dc50-4d64-9e9f-23474a22b9a8 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:39.380521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f430-dc50-4d64-9e9f-23474a22b9a8 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:39.385142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:39.385780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.386061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.386334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.387077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:39.389164 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.472218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1329/2636] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:39 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:39.476495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:39.486340 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e28b-7bde-47e4-8f05-e637d37c2a3e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:39.540400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:39.541055 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.541339 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.541620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.542297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:39.544205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.646480 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1308/2637] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:39 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:39.651667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:39.664274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e8733-fda2-4250-b375-552ac6258890 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:39.669574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:39.670523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.670839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.671116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.671849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:39.673493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.684055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1330/2638] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:39.688991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:39.698726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335f962-4233-4193-a5ac-63c7423ec291 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:39.704364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515495-175e-49a7-a5d9-19fe3ab2847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:39.705032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515495-175e-49a7-a5d9-19fe3ab2847b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.705316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515495-175e-49a7-a5d9-19fe3ab2847b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.705593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515495-175e-49a7-a5d9-19fe3ab2847b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.706319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9515495-175e-49a7-a5d9-19fe3ab2847b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:39.708049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9515495-175e-49a7-a5d9-19fe3ab2847b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.718826 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1309/2639] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:39.722538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:39.732943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2087ea1-3515-4e10-b0c5-7f5c0f453550 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:39.737504 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:39.738377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.738690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.738970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] PATH_INFO: `/v3/projects/6ac191501c114d8799cd00e4136e99bc/users/bfb88ffac2fd4b90835f57e64b5800d9/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.753789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac191501c114d8799cd00e4136e99bc, user_id=bfb88ffac2fd4b90835f57e64b5800d9, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:39.756480 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.823136 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1331/2640] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:39 2022] PUT /identity/v3/projects/6ac191501c114d8799cd00e4136e99bc/users/bfb88ffac2fd4b90835f57e64b5800d9/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:39.828753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390ab3-0919-4dd5-a404-9196bf93c825 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.829083 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390ab3-0919-4dd5-a404-9196bf93c825 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.829409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390ab3-0919-4dd5-a404-9196bf93c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.847597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-0c390ab3-0919-4dd5-a404-9196bf93c825 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:39.848778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0c390ab3-0919-4dd5-a404-9196bf93c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:39.908678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1310/2641] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:39.918255 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:39.920084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:39.974286 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56285764-986e-422e-8d4e-9b99054be5db admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:39.977821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:39.978456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:39.978768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:39.979048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:39.988299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:39.989697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:39.998907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1332/2642] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:41.303284 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70465357-c9de-4333-8747-773997b21e76 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:41.303883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70465357-c9de-4333-8747-773997b21e76 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:41.303883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70465357-c9de-4333-8747-773997b21e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:41.333291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-70465357-c9de-4333-8747-773997b21e76 None None] MFA Rules not processed for user `bfb88ffac2fd4b90835f57e64b5800d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:41.334556 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-70465357-c9de-4333-8747-773997b21e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:41.399983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1311/2643] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:41.404507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:41.413903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c4c28-9b31-41ec-9eec-78df0df08664 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:41.418440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:41.419126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:41.419944 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:41.420223 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:41.421034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:41.422959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:41.527832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1333/2644] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:41 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:41.532121 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70465357-c9de-4333-8747-773997b21e76 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:41.542655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70465357-c9de-4333-8747-773997b21e76 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:41.599554 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:41.600225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:41.600510 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:41.600786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:41.601486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:41.603415 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:41.708146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1312/2645] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:41 2022] POST /identity/v3/users => generated 308 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:41.712171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:41.723254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9739-de93-4df9-a87f-233a325c207a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:41.727806 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:41.730411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:41.730411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:41.730411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:41.730411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:41.731365 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:41.741844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1334/2646] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:41.746115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:41.756639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f553d-2669-47d5-949f-92a947a49ab5 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:41.761208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:41.762079 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:41.762356 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:41.762649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] PATH_INFO: `/v3/projects/a3ca4a133a7043e4a894e84bf4764c15/users/d4650e7c20a8479f9f1ee2f604bf2a06/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:41.778981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ca4a133a7043e4a894e84bf4764c15, user_id=d4650e7c20a8479f9f1ee2f604bf2a06, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:41.781623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:41.856112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1313/2647] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:41 2022] PUT /identity/v3/projects/a3ca4a133a7043e4a894e84bf4764c15/users/d4650e7c20a8479f9f1ee2f604bf2a06/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:29:41.860188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:41.870903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c861056-234f-4960-8d22-174f368db5d6 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:41.926739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738e9f0-bda9-4c76-ac51-97b5800c9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:41.927397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738e9f0-bda9-4c76-ac51-97b5800c9a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:41.927693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738e9f0-bda9-4c76-ac51-97b5800c9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:41.927949 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738e9f0-bda9-4c76-ac51-97b5800c9a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:41.928754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738e9f0-bda9-4c76-ac51-97b5800c9a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:41.930281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738e9f0-bda9-4c76-ac51-97b5800c9a9e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:41.940254 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1335/2648] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:41.944445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:41.955012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99020bd-18a0-4fab-8c31-e54dd482c19c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:41.959499 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:41.960362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:41.960639 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:41.960910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] PATH_INFO: `/v3/projects/a3ca4a133a7043e4a894e84bf4764c15/users/d4650e7c20a8479f9f1ee2f604bf2a06/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:41.962866 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ca4a133a7043e4a894e84bf4764c15, user_id=d4650e7c20a8479f9f1ee2f604bf2a06, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:41.965437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:41.975229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1314/2649] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:41 2022] PUT /identity/v3/projects/a3ca4a133a7043e4a894e84bf4764c15/users/d4650e7c20a8479f9f1ee2f604bf2a06/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:43.322872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6781ae5-1a0e-4169-b166-39e6edece2d8 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:43.323472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6781ae5-1a0e-4169-b166-39e6edece2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:43.323472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6781ae5-1a0e-4169-b166-39e6edece2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:43.350753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-f6781ae5-1a0e-4169-b166-39e6edece2d8 None None] MFA Rules not processed for user `d4650e7c20a8479f9f1ee2f604bf2a06`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:43.352151 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f6781ae5-1a0e-4169-b166-39e6edece2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:43.423382 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1336/2650] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:44.991474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:45.068296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3acbc-e9fe-4ebc-9bc6-d4ca8558a516 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:45.072859 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:45.073714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:45.074012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:45.074258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] PATH_INFO: `/v3/users/bfb88ffac2fd4b90835f57e64b5800d9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:45.075482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb88ffac2fd4b90835f57e64b5800d9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:45.078172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:45.241160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb88ffac2fd4b90835f57e64b5800d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.303416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb88ffac2fd4b90835f57e64b5800d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.316278 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb88ffac2fd4b90835f57e64b5800d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.316988 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb88ffac2fd4b90835f57e64b5800d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.317604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb88ffac2fd4b90835f57e64b5800d9'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.330594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1315/2651] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:29:44 2022] DELETE /identity/v3/users/bfb88ffac2fd4b90835f57e64b5800d9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:45.595872 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6781ae5-1a0e-4169-b166-39e6edece2d8 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:45.606973 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6781ae5-1a0e-4169-b166-39e6edece2d8 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:45.665802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:45.666725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:45.667009 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:45.667281 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] PATH_INFO: `/v3/projects/6ac191501c114d8799cd00e4136e99bc` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:45.668571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac191501c114d8799cd00e4136e99bc)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:45.671428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:45.777965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac191501c114d8799cd00e4136e99bc', 'request_id': 'req-c61f571d-e36d-428d-aae2-26a3e301a05b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.783955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac191501c114d8799cd00e4136e99bc', 'request_id': 'req-c61f571d-e36d-428d-aae2-26a3e301a05b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.955120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac191501c114d8799cd00e4136e99bc', 'request_id': 'req-c61f571d-e36d-428d-aae2-26a3e301a05b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.967300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] The token cache is being invalidate because project 6ac191501c114d8799cd00e4136e99bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:29:45.967574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.968212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:45.969725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1337/2652] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:29:45 2022] DELETE /identity/v3/projects/6ac191501c114d8799cd00e4136e99bc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:45.973912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:45.980693 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:45.989040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5a71-2d30-4433-bce7-19630b1e46fc admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:46.045660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:46.046534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:46.046840 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:46.047120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] PATH_INFO: `/v3/users/d4650e7c20a8479f9f1ee2f604bf2a06` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:46.048322 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4650e7c20a8479f9f1ee2f604bf2a06)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:46.050235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:46.362909 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4650e7c20a8479f9f1ee2f604bf2a06'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:46.519146 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4650e7c20a8479f9f1ee2f604bf2a06'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:46.531451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4650e7c20a8479f9f1ee2f604bf2a06'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:46.535853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4650e7c20a8479f9f1ee2f604bf2a06'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:46.535853 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bb9b8a7d-30d6-41c5-b13d-0e5ad8219dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4650e7c20a8479f9f1ee2f604bf2a06'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:46.544274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1316/2653] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:29:45 2022] DELETE /identity/v3/users/d4650e7c20a8479f9f1ee2f604bf2a06 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:46.790390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:46.791947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:46.804767 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f571d-e36d-428d-aae2-26a3e301a05b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:46.862200 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:46.863079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:46.863356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:46.863627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] PATH_INFO: `/v3/projects/a3ca4a133a7043e4a894e84bf4764c15` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:46.864807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ca4a133a7043e4a894e84bf4764c15)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:46.866721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:46.990745 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ca4a133a7043e4a894e84bf4764c15', 'request_id': 'req-33cad33f-dfe2-4081-a714-fae6de5eff5e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:46.996092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ca4a133a7043e4a894e84bf4764c15', 'request_id': 'req-33cad33f-dfe2-4081-a714-fae6de5eff5e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:47.075023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ca4a133a7043e4a894e84bf4764c15', 'request_id': 'req-33cad33f-dfe2-4081-a714-fae6de5eff5e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:47.087383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] The token cache is being invalidate because project a3ca4a133a7043e4a894e84bf4764c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:29:47.091177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:47.091177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-33cad33f-dfe2-4081-a714-fae6de5eff5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:47.091177 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1338/2654] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:29:46 2022] DELETE /identity/v3/projects/a3ca4a133a7043e4a894e84bf4764c15 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:47.095476 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609a224-2ed9-452c-882a-5cf5f6ffac68 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.096244 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609a224-2ed9-452c-882a-5cf5f6ffac68 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.096464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609a224-2ed9-452c-882a-5cf5f6ffac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.113991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-9609a224-2ed9-452c-882a-5cf5f6ffac68 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:47.115220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9609a224-2ed9-452c-882a-5cf5f6ffac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:47.174087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1317/2655] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:47.181715 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf0ade-e61b-45b8-89f9-5d8b3bf3c322 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.182000 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf0ade-e61b-45b8-89f9-5d8b3bf3c322 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.182275 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf0ade-e61b-45b8-89f9-5d8b3bf3c322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.202166 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-58bf0ade-e61b-45b8-89f9-5d8b3bf3c322 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:47.203386 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-58bf0ade-e61b-45b8-89f9-5d8b3bf3c322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:47.211096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1339/2656] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:47.215261 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609a224-2ed9-452c-882a-5cf5f6ffac68 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:47.224968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609a224-2ed9-452c-882a-5cf5f6ffac68 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:47.229559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:47.230234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.230557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.230865 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.231585 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:29:47.231894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:47.233464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:47.244628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1318/2657] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:29:47.249274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf0ade-e61b-45b8-89f9-5d8b3bf3c322 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:47.258133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf0ade-e61b-45b8-89f9-5d8b3bf3c322 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:47.262802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:47.264056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.264442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.264720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.265408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:47.267308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:47.367471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1340/2658] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:47 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:47.371525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:47.382037 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be936-913a-4dfb-8c0e-c4c0afc73545 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:47.436015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:47.436698 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.436979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.437258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.437950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:47.439903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:47.537548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1319/2659] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:47 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:47.541628 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:47.551833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930a5d1-be3e-4021-bca7-4807f9e3a984 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:47.556378 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:47.557030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.557310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.557586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.558307 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:47.559935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:47.569971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1341/2660] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:47.573778 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:47.584312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4047f7-a054-430e-afa7-61c084c3a8ad admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:47.589061 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca139-313c-4bb5-bfb8-6945a73745cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:47.595008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca139-313c-4bb5-bfb8-6945a73745cd admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.595008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca139-313c-4bb5-bfb8-6945a73745cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.595008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca139-313c-4bb5-bfb8-6945a73745cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.595008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ca139-313c-4bb5-bfb8-6945a73745cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:47.595008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ca139-313c-4bb5-bfb8-6945a73745cd admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:47.603327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1320/2661] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:47.607498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:47.617458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02417a03-84cc-423b-81a1-61fa37c0a534 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:47.622213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:47.623171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.623420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.623691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] PATH_INFO: `/v3/projects/79f5592b791145779c094ad99527e2e7/users/0bf828a5dbab45e8b780fd9738c044c6/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.637743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f5592b791145779c094ad99527e2e7, user_id=0bf828a5dbab45e8b780fd9738c044c6, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:47.641085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:47.721505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1342/2662] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:47 2022] PUT /identity/v3/projects/79f5592b791145779c094ad99527e2e7/users/0bf828a5dbab45e8b780fd9738c044c6/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:47.732842 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d131f2c-f4bd-4b82-85fb-bf411e069e27 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.733128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d131f2c-f4bd-4b82-85fb-bf411e069e27 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.733403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d131f2c-f4bd-4b82-85fb-bf411e069e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.759749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-7d131f2c-f4bd-4b82-85fb-bf411e069e27 None None] MFA Rules not processed for user `0bf828a5dbab45e8b780fd9738c044c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:47.760942 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-7d131f2c-f4bd-4b82-85fb-bf411e069e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:47.822189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1321/2663] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:29:47.827551 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:47.886341 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e01cb-e163-4dd2-b54f-2a5b39a14215 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:47.891588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:47.892306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:47.892588 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:47.892859 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:47.893542 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:47.895490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:47.984927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1343/2664] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:47 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:47.988870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d131f2c-f4bd-4b82-85fb-bf411e069e27 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:48.000031 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d131f2c-f4bd-4b82-85fb-bf411e069e27 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:48.059918 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:48.061142 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.061509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.062288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.062498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:48.066354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:48.156372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1322/2665] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:47 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:29:48.159683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:48.170902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dd76a-2a1f-4771-85bd-e80320bbdeb1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:48.175590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:48.176249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.176555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.176836 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.177570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:48.179173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:48.190829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1344/2666] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:48.194856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:48.204712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf952-7c9a-4b87-add3-ddde119ca3a1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:48.209285 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:48.210156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.210483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.210745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] PATH_INFO: `/v3/projects/d2afefb1ca6d4215a096b5cd330e2d77/users/aaf4fa58e0b740a1ba56d84135c29874/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.224983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2afefb1ca6d4215a096b5cd330e2d77, user_id=aaf4fa58e0b740a1ba56d84135c29874, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:48.241367 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:48.315451 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1323/2667] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:48 2022] PUT /identity/v3/projects/d2afefb1ca6d4215a096b5cd330e2d77/users/aaf4fa58e0b740a1ba56d84135c29874/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:48.319476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:48.330261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80db73-f047-4d05-bc3b-81f93c24d346 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:48.386287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567230-83ce-43e0-8464-2d84a92c2ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:48.387016 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567230-83ce-43e0-8464-2d84a92c2ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.387305 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567230-83ce-43e0-8464-2d84a92c2ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.387582 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567230-83ce-43e0-8464-2d84a92c2ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.388834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567230-83ce-43e0-8464-2d84a92c2ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:48.390518 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567230-83ce-43e0-8464-2d84a92c2ab0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:48.400291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1345/2668] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:48.405032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:48.415245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc36af-934c-4c8a-ac3f-6dcf2fde47c7 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:48.420066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:48.429179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.429179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.429179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] PATH_INFO: `/v3/projects/d2afefb1ca6d4215a096b5cd330e2d77/users/aaf4fa58e0b740a1ba56d84135c29874/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.429179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2afefb1ca6d4215a096b5cd330e2d77, user_id=aaf4fa58e0b740a1ba56d84135c29874, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:48.429179 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:48.436327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1324/2669] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:48 2022] PUT /identity/v3/projects/d2afefb1ca6d4215a096b5cd330e2d77/users/aaf4fa58e0b740a1ba56d84135c29874/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:48.446216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3073d-9ef7-4425-85cf-2de8b46bbb24 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.446505 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3073d-9ef7-4425-85cf-2de8b46bbb24 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.446816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3073d-9ef7-4425-85cf-2de8b46bbb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.474298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-57f3073d-9ef7-4425-85cf-2de8b46bbb24 None None] MFA Rules not processed for user `aaf4fa58e0b740a1ba56d84135c29874`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:48.475522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-57f3073d-9ef7-4425-85cf-2de8b46bbb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:48.541596 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1346/2670] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:48.552628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:48.554335 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:48.610490 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6ba73-feff-4155-a835-c313b2a0a37e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:48.614177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abade8f0-5eff-4f95-8282-26ad774c8d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:48.614850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade8f0-5eff-4f95-8282-26ad774c8d45 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.615131 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade8f0-5eff-4f95-8282-26ad774c8d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.615399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade8f0-5eff-4f95-8282-26ad774c8d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.625345 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abade8f0-5eff-4f95-8282-26ad774c8d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:48.626796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abade8f0-5eff-4f95-8282-26ad774c8d45 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:48.636169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1325/2671] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:48.664638 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3073d-9ef7-4425-85cf-2de8b46bbb24 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:48.726030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3073d-9ef7-4425-85cf-2de8b46bbb24 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:48.730867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:48.731698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:48.732068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:48.732374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] PATH_INFO: `/v3/users/0bf828a5dbab45e8b780fd9738c044c6` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:48.733576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf828a5dbab45e8b780fd9738c044c6)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:48.735511 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:48.938418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf828a5dbab45e8b780fd9738c044c6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:48.939126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf828a5dbab45e8b780fd9738c044c6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:48.945692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf828a5dbab45e8b780fd9738c044c6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.023435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf828a5dbab45e8b780fd9738c044c6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.024095 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf828a5dbab45e8b780fd9738c044c6'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.042561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1347/2672] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:29:48 2022] DELETE /identity/v3/users/0bf828a5dbab45e8b780fd9738c044c6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:49.047181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:49.047469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:49.047745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:49.066506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:49.067716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:49.124248 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1326/2673] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:49.133854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:49.135280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:49.191340 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72f18f-7ccc-475b-80b2-ef667f6ba267 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:49.194809 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:49.195450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:49.195728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:49.195999 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:49.204600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:49.206116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:49.215173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1348/2674] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:49.619905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:49.621551 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:49.634109 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778357-08b2-4065-b0cc-6e9b6da12891 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:49.639431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:49.641997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:49.641997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:49.641997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] PATH_INFO: `/v3/projects/79f5592b791145779c094ad99527e2e7` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:49.642301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f5592b791145779c094ad99527e2e7)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:49.643999 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:49.782511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f5592b791145779c094ad99527e2e7', 'request_id': 'req-bdeea9dc-4047-4749-8923-cc5fd6ab4121'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.909008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f5592b791145779c094ad99527e2e7', 'request_id': 'req-bdeea9dc-4047-4749-8923-cc5fd6ab4121'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.914717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f5592b791145779c094ad99527e2e7', 'request_id': 'req-bdeea9dc-4047-4749-8923-cc5fd6ab4121'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.925796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] The token cache is being invalidate because project 79f5592b791145779c094ad99527e2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:29:49.926078 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.926732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:49.928246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1327/2675] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:29:49 2022] DELETE /identity/v3/projects/79f5592b791145779c094ad99527e2e7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:49.932208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:49.942540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc707-98a7-488a-8bb0-636a309b68ea service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:49.997631 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:49.998592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:49.998810 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:49.999085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] PATH_INFO: `/v3/users/aaf4fa58e0b740a1ba56d84135c29874` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:50.000304 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf4fa58e0b740a1ba56d84135c29874)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:50.002203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:50.174214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf4fa58e0b740a1ba56d84135c29874'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:50.174905 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf4fa58e0b740a1ba56d84135c29874'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:50.181569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf4fa58e0b740a1ba56d84135c29874'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:50.245953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf4fa58e0b740a1ba56d84135c29874'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:50.246674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c1476aef-74bc-4584-be25-30a75cbc021c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf4fa58e0b740a1ba56d84135c29874'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:50.264359 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1349/2676] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:29:49 2022] DELETE /identity/v3/users/aaf4fa58e0b740a1ba56d84135c29874 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:50.762048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:50.762048 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:50.777932 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea9dc-4047-4749-8923-cc5fd6ab4121 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:50.834045 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:50.834941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:50.835222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:50.835496 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] PATH_INFO: `/v3/projects/d2afefb1ca6d4215a096b5cd330e2d77` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:50.836674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2afefb1ca6d4215a096b5cd330e2d77)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:50.838560 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:50.948625 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2afefb1ca6d4215a096b5cd330e2d77', 'request_id': 'req-2ddb95fb-1d4e-4709-b954-b5cd5c048680'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:51.017465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2afefb1ca6d4215a096b5cd330e2d77', 'request_id': 'req-2ddb95fb-1d4e-4709-b954-b5cd5c048680'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:51.023384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2afefb1ca6d4215a096b5cd330e2d77', 'request_id': 'req-2ddb95fb-1d4e-4709-b954-b5cd5c048680'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:51.034804 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] The token cache is being invalidate because project d2afefb1ca6d4215a096b5cd330e2d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:29:51.035091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:51.035724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-2ddb95fb-1d4e-4709-b954-b5cd5c048680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:51.037424 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1328/2677] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:29:50 2022] DELETE /identity/v3/projects/d2afefb1ca6d4215a096b5cd330e2d77 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:51.042233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ef38-7ad5-4f70-a26b-630277efc396 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.042753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ef38-7ad5-4f70-a26b-630277efc396 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.042873 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ef38-7ad5-4f70-a26b-630277efc396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.061801 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-37f6ef38-7ad5-4f70-a26b-630277efc396 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:51.062362 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-37f6ef38-7ad5-4f70-a26b-630277efc396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:51.121245 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1350/2678] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:51.129835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924159-f95c-4856-ab0a-803cef6b2ef5 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.130119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924159-f95c-4856-ab0a-803cef6b2ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.130394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924159-f95c-4856-ab0a-803cef6b2ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.148615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-a2924159-f95c-4856-ab0a-803cef6b2ef5 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:51.150069 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-a2924159-f95c-4856-ab0a-803cef6b2ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:51.158002 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1329/2679] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:29:51.162123 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ef38-7ad5-4f70-a26b-630277efc396 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:51.172116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ef38-7ad5-4f70-a26b-630277efc396 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:51.176615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:51.177253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.177530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.177801 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.178539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:29:51.178876 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:51.180443 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:51.192059 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1351/2680] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:29:51.196492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2924159-f95c-4856-ab0a-803cef6b2ef5 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:51.205503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2924159-f95c-4856-ab0a-803cef6b2ef5 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:51.210087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:51.210758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.211036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.211302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.211992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:51.213852 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:51.308507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1330/2681] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:51 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:51.313493 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:51.323412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4dbf-982c-4810-8fc3-d5403efaa092 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:51.376965 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:51.377622 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.377901 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.378175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.378884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:51.380763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:51.496360 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1352/2682] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:51 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:51.500751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:51.518908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759f4b6-a7f9-4662-a534-8f80624c5581 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:51.518908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:51.518908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.518908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.519319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.519319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:51.519514 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:51.530686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1331/2683] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:51.534543 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:51.544578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969116c-7edb-4cc9-b40b-b49a584a7ec6 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:51.549736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4142a-53f2-4430-b6d2-73d8e23ab24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:51.550470 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4142a-53f2-4430-b6d2-73d8e23ab24f admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.550786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4142a-53f2-4430-b6d2-73d8e23ab24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.551062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4142a-53f2-4430-b6d2-73d8e23ab24f admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.551773 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4142a-53f2-4430-b6d2-73d8e23ab24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:51.553342 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4142a-53f2-4430-b6d2-73d8e23ab24f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:51.563890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1353/2684] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:29:51.567770 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:51.578205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5243bd2-f4e0-45ed-ad0d-6a19012eb365 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:51.582851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:51.583728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.584038 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.584314 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] PATH_INFO: `/v3/projects/52be5f7ca6ea4223a85e1655cc36ddaa/users/aaa5ba63fee44cf3bf371bfb57b11370/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.598913 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52be5f7ca6ea4223a85e1655cc36ddaa, user_id=aaa5ba63fee44cf3bf371bfb57b11370, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:51.601575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:51.828087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1332/2685] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:51 2022] PUT /identity/v3/projects/52be5f7ca6ea4223a85e1655cc36ddaa/users/aaa5ba63fee44cf3bf371bfb57b11370/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:51.839096 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c778-1564-4cf8-8371-3e1e8acc4f55 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.851100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c778-1564-4cf8-8371-3e1e8acc4f55 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.851100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c778-1564-4cf8-8371-3e1e8acc4f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:51.866529 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-d579c778-1564-4cf8-8371-3e1e8acc4f55 None None] MFA Rules not processed for user `aaa5ba63fee44cf3bf371bfb57b11370`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:51.867754 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-d579c778-1564-4cf8-8371-3e1e8acc4f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:51.930429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1354/2686] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:51.934926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:51.993626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c04fe-3b16-4d00-9fc4-d88c51df9921 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:51.998720 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:51.999376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:51.999659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:51.999933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.000617 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.002515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.134021 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1333/2687] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:51 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:52.138036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c778-1564-4cf8-8371-3e1e8acc4f55 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.148434 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c778-1564-4cf8-8371-3e1e8acc4f55 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.202555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.203246 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.203527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.203799 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.204522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.206424 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.292064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1355/2688] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:52 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:52.296716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.307070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb3ffb-ac20-4804-bb59-e3bfcc71c776 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.314283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.314973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.315263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.315540 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.316273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.318026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.328898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1334/2689] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:52.332877 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.343794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d1b0-0486-4f31-af19-841621476899 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.348387 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a57e51-de89-48c3-801e-6fe93e26404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.349043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57e51-de89-48c3-801e-6fe93e26404d admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.349325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57e51-de89-48c3-801e-6fe93e26404d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.349601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57e51-de89-48c3-801e-6fe93e26404d admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.350329 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a57e51-de89-48c3-801e-6fe93e26404d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.351956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a57e51-de89-48c3-801e-6fe93e26404d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.362720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1356/2690] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:52.366816 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.376477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52787e-6c08-47fb-9173-1229f00ae51b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.380970 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.381833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.382113 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.382385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] PATH_INFO: `/v3/projects/a3d54055fc4045c79abe368b70fd6b40/users/0b7f9b6941c947f0be6fe08e083d977e/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.396377 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d54055fc4045c79abe368b70fd6b40, user_id=0b7f9b6941c947f0be6fe08e083d977e, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.398950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.468969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1335/2691] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:52 2022] PUT /identity/v3/projects/a3d54055fc4045c79abe368b70fd6b40/users/0b7f9b6941c947f0be6fe08e083d977e/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:52.483964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc807177-c0ae-446e-a918-3368f91eeb2a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.484257 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc807177-c0ae-446e-a918-3368f91eeb2a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.484538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc807177-c0ae-446e-a918-3368f91eeb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.510860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-cc807177-c0ae-446e-a918-3368f91eeb2a None None] MFA Rules not processed for user `0b7f9b6941c947f0be6fe08e083d977e`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:52.512058 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-cc807177-c0ae-446e-a918-3368f91eeb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:52.577499 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1357/2692] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:52.581958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.645311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a7d9b-75e0-4ed6-9fbe-672888a0df59 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.650330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.650959 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.651246 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.651543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.652222 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.654271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.750980 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1336/2693] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:29:52 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:52.755103 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc807177-c0ae-446e-a918-3368f91eeb2a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.766829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc807177-c0ae-446e-a918-3368f91eeb2a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.821760 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.822418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.822729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.823013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.823705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.825602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.914429 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1358/2694] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:29:52 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:29:52.918260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.928597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2029-3437-4692-b231-17720390e23e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.933219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.933871 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.934153 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.934428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.935279 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.936903 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:52.948208 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1337/2695] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:52.952601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:52.962316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd91210-47ab-4456-8a09-28dce8d95ffc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:52.967683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:52.968553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:52.968830 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:52.969101 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] PATH_INFO: `/v3/projects/f9e7daa94d8248d5b569073971889b55/users/c96b90fd410b43d6b52402a2603ed004/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:52.985061 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e7daa94d8248d5b569073971889b55, user_id=c96b90fd410b43d6b52402a2603ed004, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:52.987710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:53.087204 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1359/2696] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:52 2022] PUT /identity/v3/projects/f9e7daa94d8248d5b569073971889b55/users/c96b90fd410b43d6b52402a2603ed004/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:53.092559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:53.103114 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8acfff-ffc8-41f5-995d-56674cfb0de5 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:53.159812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa71392-d28c-4964-857c-c77db3cdb687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:53.160470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71392-d28c-4964-857c-c77db3cdb687 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:53.160749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71392-d28c-4964-857c-c77db3cdb687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:53.161019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71392-d28c-4964-857c-c77db3cdb687 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:53.161734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa71392-d28c-4964-857c-c77db3cdb687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:53.163336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa71392-d28c-4964-857c-c77db3cdb687 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:53.173180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1338/2697] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:29:53.177233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:53.188056 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79644a83-44b5-4c10-a353-36a3fde0d44a admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:53.192721 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:53.193589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:53.193865 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:53.194137 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] PATH_INFO: `/v3/projects/f9e7daa94d8248d5b569073971889b55/users/c96b90fd410b43d6b52402a2603ed004/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:53.196107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e7daa94d8248d5b569073971889b55, user_id=c96b90fd410b43d6b52402a2603ed004, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:53.198723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:53.209561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1360/2698] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:29:53 2022] PUT /identity/v3/projects/f9e7daa94d8248d5b569073971889b55/users/c96b90fd410b43d6b52402a2603ed004/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:53.221751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:53.222095 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:53.222372 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:53.248354 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] MFA Rules not processed for user `c96b90fd410b43d6b52402a2603ed004`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:53.249659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:53.315318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1339/2699] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:53.326938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:53.328625 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:53.382829 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbbb93-94ff-4e25-84d5-61858e2882d8 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:53.386385 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:53.387037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:53.387316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:53.387585 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:53.396404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:53.397807 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:53.407259 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1361/2700] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:53.525679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:53.527216 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:53.540273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68048aa8-0a7d-4445-99ab-5408b5e8a05b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:53.546035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f39be-b99a-4455-8e5b-f1124b379ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:53.546702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f39be-b99a-4455-8e5b-f1124b379ffc service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:53.546984 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f39be-b99a-4455-8e5b-f1124b379ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:53.547252 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f39be-b99a-4455-8e5b-f1124b379ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:53.601493 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f39be-b99a-4455-8e5b-f1124b379ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:53.602954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f39be-b99a-4455-8e5b-f1124b379ffc service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:53.612149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1340/2701] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:59.033928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:59.095552 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257562d-45fc-4559-b9ff-3db2d91525c3 service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:59.100271 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:59.101138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:59.101420 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:59.101720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] PATH_INFO: `/v3/users/aaa5ba63fee44cf3bf371bfb57b11370` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:59.102985 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa5ba63fee44cf3bf371bfb57b11370)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:59.104981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:59.292313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa5ba63fee44cf3bf371bfb57b11370'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:59.292898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa5ba63fee44cf3bf371bfb57b11370'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:59.300620 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa5ba63fee44cf3bf371bfb57b11370'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:59.381875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa5ba63fee44cf3bf371bfb57b11370'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:59.382496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa5ba63fee44cf3bf371bfb57b11370'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:29:59.400501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1362/2702] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:29:59 2022] DELETE /identity/v3/users/aaa5ba63fee44cf3bf371bfb57b11370 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:29:59.408189 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:59.408712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:59.410721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:59.427733 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:29:59.428948 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:59.487157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1341/2703] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:29:59.496792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:59.498287 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:29:59.553735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff05bcc-3cf4-43b3-b6ce-b6d905617544 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:29:59.557201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:29:59.557837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:29:59.558113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:29:59.558384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:29:59.568238 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:29:59.569696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:29:59.579408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1363/2704] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:29:59.989191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:29:59.990632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:00.004704 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcab23-ae33-435c-8245-fbd81a34a361 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:00.009433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:00.010295 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:00.010573 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:00.010880 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] PATH_INFO: `/v3/projects/52be5f7ca6ea4223a85e1655cc36ddaa` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:00.012057 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=52be5f7ca6ea4223a85e1655cc36ddaa)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:00.014808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:00.125139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52be5f7ca6ea4223a85e1655cc36ddaa', 'request_id': 'req-b39c0e03-3e77-476e-92f1-3dd6421306bb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.234887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52be5f7ca6ea4223a85e1655cc36ddaa', 'request_id': 'req-b39c0e03-3e77-476e-92f1-3dd6421306bb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.240661 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52be5f7ca6ea4223a85e1655cc36ddaa', 'request_id': 'req-b39c0e03-3e77-476e-92f1-3dd6421306bb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.251833 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] The token cache is being invalidate because project 52be5f7ca6ea4223a85e1655cc36ddaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:30:00.252115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.252729 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.254253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1342/2705] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:29:59 2022] DELETE /identity/v3/projects/52be5f7ca6ea4223a85e1655cc36ddaa => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:00.258197 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:00.268268 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de79223-448f-4c4c-849e-32d12f4d4dd2 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:00.321521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:00.322313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:00.322586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:00.322887 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] PATH_INFO: `/v3/users/0b7f9b6941c947f0be6fe08e083d977e` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:00.329408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7f9b6941c947f0be6fe08e083d977e)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:00.329408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:00.591111 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7f9b6941c947f0be6fe08e083d977e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.592235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7f9b6941c947f0be6fe08e083d977e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.598948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7f9b6941c947f0be6fe08e083d977e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.680395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7f9b6941c947f0be6fe08e083d977e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.681014 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7f9b6941c947f0be6fe08e083d977e'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:00.698326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1364/2706] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:30:00 2022] DELETE /identity/v3/users/0b7f9b6941c947f0be6fe08e083d977e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:01.111110 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:01.112623 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:01.125532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c0e03-3e77-476e-92f1-3dd6421306bb admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:01.183609 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:01.184473 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:01.184756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:01.185034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] PATH_INFO: `/v3/projects/a3d54055fc4045c79abe368b70fd6b40` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:01.186223 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d54055fc4045c79abe368b70fd6b40)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:01.188193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:01.303228 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d54055fc4045c79abe368b70fd6b40', 'request_id': 'req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.400716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d54055fc4045c79abe368b70fd6b40', 'request_id': 'req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.407258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d54055fc4045c79abe368b70fd6b40', 'request_id': 'req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.418205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] The token cache is being invalidate because project a3d54055fc4045c79abe368b70fd6b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:30:01.418498 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.419182 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.422141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1343/2707] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:30:01 2022] DELETE /identity/v3/projects/a3d54055fc4045c79abe368b70fd6b40 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:01.425556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:01.427034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:01.439538 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3daa87-ef26-4b87-96c4-2df52313f0fd admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:01.493503 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:01.494398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:01.494711 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:01.495002 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] PATH_INFO: `/v3/users/c96b90fd410b43d6b52402a2603ed004` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:01.496161 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96b90fd410b43d6b52402a2603ed004)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:01.498211 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:01.757556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96b90fd410b43d6b52402a2603ed004'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.758210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96b90fd410b43d6b52402a2603ed004'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.765237 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96b90fd410b43d6b52402a2603ed004'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.875089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96b90fd410b43d6b52402a2603ed004'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.875710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ce6bb884-6aa0-43f8-aa9c-e26ee3cc1dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96b90fd410b43d6b52402a2603ed004'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:01.893698 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1365/2708] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:30:01 2022] DELETE /identity/v3/users/c96b90fd410b43d6b52402a2603ed004 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:02.315635 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:02.317166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:02.331074 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c70cd-7de6-4537-9b8c-e1a0668d263c admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:02.389054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:02.389936 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:02.390197 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:02.390464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] PATH_INFO: `/v3/projects/f9e7daa94d8248d5b569073971889b55` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:02.391710 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e7daa94d8248d5b569073971889b55)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:02.393603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:02.566500 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e7daa94d8248d5b569073971889b55', 'request_id': 'req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:02.629297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e7daa94d8248d5b569073971889b55', 'request_id': 'req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:02.635056 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e7daa94d8248d5b569073971889b55', 'request_id': 'req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:02.646745 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] The token cache is being invalidate because project f9e7daa94d8248d5b569073971889b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:30:02.647032 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:02.647682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-fd6d1c3a-8a7e-45b4-8b23-b7d6aa096a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:02.649203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1344/2709] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:30:02 2022] DELETE /identity/v3/projects/f9e7daa94d8248d5b569073971889b55 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:02.655375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6605b7-e527-4f4a-b1c5-e7406bbdd4af None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:02.655847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6605b7-e527-4f4a-b1c5-e7406bbdd4af None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:02.655955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6605b7-e527-4f4a-b1c5-e7406bbdd4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:02.674266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-ed6605b7-e527-4f4a-b1c5-e7406bbdd4af None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:02.675497 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ed6605b7-e527-4f4a-b1c5-e7406bbdd4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:02.735051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1366/2710] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:02.793257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e0758-e7d0-41fe-9c4d-2a6bb14c6c9d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:02.793543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e0758-e7d0-41fe-9c4d-2a6bb14c6c9d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:02.793823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e0758-e7d0-41fe-9c4d-2a6bb14c6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:02.813126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-534e0758-e7d0-41fe-9c4d-2a6bb14c6c9d None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:02.814320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-534e0758-e7d0-41fe-9c4d-2a6bb14c6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:02.822226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1345/2711] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:02.826546 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6605b7-e527-4f4a-b1c5-e7406bbdd4af None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:02.835927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6605b7-e527-4f4a-b1c5-e7406bbdd4af None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:02.840409 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:02.841052 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:02.841333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:02.842110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:02.842863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:30:02.843168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:02.844740 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:02.855803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1367/2712] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:30:02.860695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e0758-e7d0-41fe-9c4d-2a6bb14c6c9d None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:02.869712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e0758-e7d0-41fe-9c4d-2a6bb14c6c9d None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:02.876327 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:02.876975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:02.877258 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:02.877533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:02.878219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:02.880147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:02.962161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1346/2713] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:30:02 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:30:02.967055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:02.983346 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410f91-8a73-42d8-8c9e-dcd10c9e5afb admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.038038 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.038728 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.039011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.039290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.040007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.041897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.145725 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1368/2714] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:30:02 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:30:03.148773 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.160304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a3e1-d899-43c1-8ffa-77bff3f0c404 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.167387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.168104 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.168383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.168658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.169440 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.171750 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.183762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1347/2715] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:30:03.188907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.199433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9781c5-6ef9-4870-b74f-8612c99a0d08 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.204445 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b48f4b-eb03-4ef5-a5a1-5d96db0dbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.205100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48f4b-eb03-4ef5-a5a1-5d96db0dbae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.205377 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48f4b-eb03-4ef5-a5a1-5d96db0dbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.205651 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48f4b-eb03-4ef5-a5a1-5d96db0dbae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.206367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b48f4b-eb03-4ef5-a5a1-5d96db0dbae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.207978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b48f4b-eb03-4ef5-a5a1-5d96db0dbae3 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.218369 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1369/2716] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:30:03.233889 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.243863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2b52-2e7c-4877-8970-57f83455757a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.249118 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.249998 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.250274 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.250638 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] PATH_INFO: `/v3/projects/2a580889000840df93adb739598e8613/users/52bfb950c2fb4dc0bfab35cdf8c0c95e/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.265292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a580889000840df93adb739598e8613, user_id=52bfb950c2fb4dc0bfab35cdf8c0c95e, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.268012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.337801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1348/2717] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:30:03 2022] PUT /identity/v3/projects/2a580889000840df93adb739598e8613/users/52bfb950c2fb4dc0bfab35cdf8c0c95e/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:03.349428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416e20-1549-4814-b1b8-afddc967a12e None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.349744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416e20-1549-4814-b1b8-afddc967a12e None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.350017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416e20-1549-4814-b1b8-afddc967a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.377026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-75416e20-1549-4814-b1b8-afddc967a12e None None] MFA Rules not processed for user `52bfb950c2fb4dc0bfab35cdf8c0c95e`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:03.378210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-75416e20-1549-4814-b1b8-afddc967a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:03.439090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1370/2718] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:03.443462 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.503390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5886a-9145-4003-a5d1-defa0e5ba5d3 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.508089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.508739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.509022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.509298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.510001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.511935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.614801 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1349/2719] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:30:03 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:30:03.618962 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416e20-1549-4814-b1b8-afddc967a12e None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.630184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416e20-1549-4814-b1b8-afddc967a12e None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.687174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48072fec-6228-460d-aff7-070602894230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.687847 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48072fec-6228-460d-aff7-070602894230 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.688127 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48072fec-6228-460d-aff7-070602894230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.688404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48072fec-6228-460d-aff7-070602894230 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.689089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48072fec-6228-460d-aff7-070602894230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.691092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48072fec-6228-460d-aff7-070602894230 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.787226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1371/2720] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:30:03 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:30:03.791231 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.801536 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb6474-bedb-4085-8f5f-f1e5faf6db0a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.806154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.806836 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.807120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.807394 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.808117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.809700 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.820691 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1350/2721] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:30:03.824743 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48072fec-6228-460d-aff7-070602894230 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.835832 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48072fec-6228-460d-aff7-070602894230 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:03.840663 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:03.841811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:03.842261 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:03.842547 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] PATH_INFO: `/v3/projects/16179aea0cc14ba7bed6bc2a1de5a259/users/1b205e7435294bc6916d18354479127c/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:03.858856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16179aea0cc14ba7bed6bc2a1de5a259, user_id=1b205e7435294bc6916d18354479127c, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:03.861763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:03.949448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1372/2722] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:30:03 2022] PUT /identity/v3/projects/16179aea0cc14ba7bed6bc2a1de5a259/users/1b205e7435294bc6916d18354479127c/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:30:03.953528 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:03.963474 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b93a-619a-47c1-a5ed-04153baf22b6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:04.018088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcb3d-976c-461d-aaaf-cd17d422d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:04.018780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcb3d-976c-461d-aaaf-cd17d422d7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:04.019063 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcb3d-976c-461d-aaaf-cd17d422d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:04.019334 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcb3d-976c-461d-aaaf-cd17d422d7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:04.020052 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defcb3d-976c-461d-aaaf-cd17d422d7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:04.021680 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defcb3d-976c-461d-aaaf-cd17d422d7a6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:04.032273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1351/2723] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:30:04.036578 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:04.047367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee43f-c5ce-4664-9d84-6353dfa8d72e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:04.051886 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:04.052762 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:04.053040 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:04.053309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] PATH_INFO: `/v3/projects/16179aea0cc14ba7bed6bc2a1de5a259/users/1b205e7435294bc6916d18354479127c/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:04.055303 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16179aea0cc14ba7bed6bc2a1de5a259, user_id=1b205e7435294bc6916d18354479127c, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:04.058167 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:04.069280 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1373/2724] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:30:04 2022] PUT /identity/v3/projects/16179aea0cc14ba7bed6bc2a1de5a259/users/1b205e7435294bc6916d18354479127c/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:04.079477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360e77-d094-4e3f-bcc5-62db4ad1a8ef None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:04.079761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360e77-d094-4e3f-bcc5-62db4ad1a8ef None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:04.080034 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360e77-d094-4e3f-bcc5-62db4ad1a8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:04.105812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-14360e77-d094-4e3f-bcc5-62db4ad1a8ef None None] MFA Rules not processed for user `1b205e7435294bc6916d18354479127c`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:04.107557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-14360e77-d094-4e3f-bcc5-62db4ad1a8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:04.175455 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1352/2725] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:04.187106 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:04.188768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:04.242948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6c0a-32f9-43b8-bd2a-a06abbe8d5f0 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:04.246510 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41fae6-ef3f-4af4-80c0-a13cf1c51006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:04.247239 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41fae6-ef3f-4af4-80c0-a13cf1c51006 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:04.247524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41fae6-ef3f-4af4-80c0-a13cf1c51006 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:04.248384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41fae6-ef3f-4af4-80c0-a13cf1c51006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:04.257046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41fae6-ef3f-4af4-80c0-a13cf1c51006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:04.258562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41fae6-ef3f-4af4-80c0-a13cf1c51006 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:04.268415 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1374/2726] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:30:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:30:05.602102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360e77-d094-4e3f-bcc5-62db4ad1a8ef None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:05.667660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360e77-d094-4e3f-bcc5-62db4ad1a8ef None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:05.672395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:05.673254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:05.673527 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:05.673797 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] PATH_INFO: `/v3/users/52bfb950c2fb4dc0bfab35cdf8c0c95e` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:05.674994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bfb950c2fb4dc0bfab35cdf8c0c95e)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:05.676870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:05.917678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bfb950c2fb4dc0bfab35cdf8c0c95e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.000660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bfb950c2fb4dc0bfab35cdf8c0c95e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.012898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bfb950c2fb4dc0bfab35cdf8c0c95e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.014198 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bfb950c2fb4dc0bfab35cdf8c0c95e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.014990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bfb950c2fb4dc0bfab35cdf8c0c95e'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.027099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1353/2727] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:30:05 2022] DELETE /identity/v3/users/52bfb950c2fb4dc0bfab35cdf8c0c95e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:06.032171 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:06.032634 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:06.032731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:06.050786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:06.051978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:06.109440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1375/2728] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:06.119120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:06.120543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:06.176448 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2e84-4115-48d4-940e-54cbf13a82aa admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:06.179969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:06.180605 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:06.180883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:06.181155 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:06.189969 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:06.191412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:06.202305 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1354/2729] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:30:06.625956 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:06.627483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:06.641188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f405e9-6a94-4c8d-9bed-d2019cc33d07 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:06.646090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:06.646990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:06.647293 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:06.648062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] PATH_INFO: `/v3/projects/2a580889000840df93adb739598e8613` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:06.649640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a580889000840df93adb739598e8613)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:06.651838 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:06.835971 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a580889000840df93adb739598e8613', 'request_id': 'req-3483d231-866c-4c70-a6df-f3151ff2adb9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.841992 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a580889000840df93adb739598e8613', 'request_id': 'req-3483d231-866c-4c70-a6df-f3151ff2adb9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.944025 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a580889000840df93adb739598e8613', 'request_id': 'req-3483d231-866c-4c70-a6df-f3151ff2adb9'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.955863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] The token cache is being invalidate because project 2a580889000840df93adb739598e8613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:30:06.956144 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.956765 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:06.958267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1376/2730] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:30:06 2022] DELETE /identity/v3/projects/2a580889000840df93adb739598e8613 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:06.962185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:06.971709 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22249a-541a-482a-9a22-1d330386d7f6 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:07.026472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:07.027905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:07.028191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:07.028464 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] PATH_INFO: `/v3/users/1b205e7435294bc6916d18354479127c` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:07.029699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b205e7435294bc6916d18354479127c)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:07.031627 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:07.244288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b205e7435294bc6916d18354479127c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:07.347978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b205e7435294bc6916d18354479127c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:07.361092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b205e7435294bc6916d18354479127c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:07.361805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b205e7435294bc6916d18354479127c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:07.362444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-67688ed5-1479-49a7-8944-2a0b2ba689e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b205e7435294bc6916d18354479127c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:07.375441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1355/2731] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:30:06 2022] DELETE /identity/v3/users/1b205e7435294bc6916d18354479127c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:07.849441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:07.851088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:07.863942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483d231-866c-4c70-a6df-f3151ff2adb9 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:07.919066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:07.920565 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:07.920843 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:07.921115 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] PATH_INFO: `/v3/projects/16179aea0cc14ba7bed6bc2a1de5a259` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:07.922289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16179aea0cc14ba7bed6bc2a1de5a259)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:07.924218 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:08.047656 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16179aea0cc14ba7bed6bc2a1de5a259', 'request_id': 'req-b8f3c247-dacf-44f8-afec-f73751b6f5f8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:08.053116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16179aea0cc14ba7bed6bc2a1de5a259', 'request_id': 'req-b8f3c247-dacf-44f8-afec-f73751b6f5f8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:08.126495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16179aea0cc14ba7bed6bc2a1de5a259', 'request_id': 'req-b8f3c247-dacf-44f8-afec-f73751b6f5f8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:08.137746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] The token cache is being invalidate because project 16179aea0cc14ba7bed6bc2a1de5a259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:30:08.138015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:08.139291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-b8f3c247-dacf-44f8-afec-f73751b6f5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:08.140842 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1377/2732] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:30:07 2022] DELETE /identity/v3/projects/16179aea0cc14ba7bed6bc2a1de5a259 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:08.145844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc171f-0671-4853-97b0-303c39e0bfa6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.146315 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc171f-0671-4853-97b0-303c39e0bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.146425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc171f-0671-4853-97b0-303c39e0bfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.165961 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b2fc171f-0671-4853-97b0-303c39e0bfa6 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:08.167191 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b2fc171f-0671-4853-97b0-303c39e0bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:08.227391 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1356/2733] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:08.234888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d214ba-362d-402b-9b7e-5288ada4d85a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.235183 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d214ba-362d-402b-9b7e-5288ada4d85a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.235464 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d214ba-362d-402b-9b7e-5288ada4d85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.258602 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-c9d214ba-362d-402b-9b7e-5288ada4d85a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:08.259930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c9d214ba-362d-402b-9b7e-5288ada4d85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:08.269139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1378/2734] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:08.273483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc171f-0671-4853-97b0-303c39e0bfa6 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:08.283908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc171f-0671-4853-97b0-303c39e0bfa6 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:08.288532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:08.289212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.289494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.289769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.290495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:30:08.290832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:08.292461 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:08.304695 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1357/2735] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:30:08.309116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d214ba-362d-402b-9b7e-5288ada4d85a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:08.319655 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d214ba-362d-402b-9b7e-5288ada4d85a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:08.324397 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:08.325046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.325401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.325680 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.327042 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:08.328951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:08.431864 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1379/2736] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:30:08 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:30:08.436082 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:08.446341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0315c5b-f27b-48d6-b87b-fa44c0eb02a8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:08.502602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:08.503296 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.503575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.503850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.504544 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:08.506470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:08.613186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1358/2737] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:30:08 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:30:08.617487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:08.627826 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce7e6f-f879-464d-be4c-e88a6bfccd4f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:08.632474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:08.634545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.634545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.634545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.634545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:08.636141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:08.647067 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1380/2738] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:30:08.651856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:08.663376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b630-7b66-4809-aff5-062674ab0fd6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:08.667997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb634-3ef3-441e-91dc-93f20f17a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:08.668655 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb634-3ef3-441e-91dc-93f20f17a52e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.668941 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb634-3ef3-441e-91dc-93f20f17a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.669219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb634-3ef3-441e-91dc-93f20f17a52e admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.669983 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb634-3ef3-441e-91dc-93f20f17a52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:08.671697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb634-3ef3-441e-91dc-93f20f17a52e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:08.681507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1359/2739] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:30:08.685895 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:08.695770 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6c135-166f-4e66-8007-c86d7979359b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:08.700301 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:08.702055 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.702333 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.702675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] PATH_INFO: `/v3/projects/aee9a6954c284e108d6da83cc7afaea0/users/8bd784b3d45e4129901409c7f645cf75/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.718374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee9a6954c284e108d6da83cc7afaea0, user_id=8bd784b3d45e4129901409c7f645cf75, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:08.721023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:08.811345 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1381/2740] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:30:08 2022] PUT /identity/v3/projects/aee9a6954c284e108d6da83cc7afaea0/users/8bd784b3d45e4129901409c7f645cf75/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:08.821534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a80e-32b1-40ca-9dbe-0e844dc3bf72 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.821827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a80e-32b1-40ca-9dbe-0e844dc3bf72 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.822112 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17a80e-32b1-40ca-9dbe-0e844dc3bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.848602 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-bc17a80e-32b1-40ca-9dbe-0e844dc3bf72 None None] MFA Rules not processed for user `8bd784b3d45e4129901409c7f645cf75`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:08.849825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-bc17a80e-32b1-40ca-9dbe-0e844dc3bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:08.912187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1360/2741] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:08.916735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:08.977299 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1f42-dfcd-4548-888f-b3e088ca215b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:08.981920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:08.983994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:08.984279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:08.984558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:08.985258 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:08.987214 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:09.116734 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1382/2742] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:30:08 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:30:09.120815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17a80e-32b1-40ca-9dbe-0e844dc3bf72 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:09.131910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17a80e-32b1-40ca-9dbe-0e844dc3bf72 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:09.187417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:09.188077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:09.188347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:09.188640 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:09.189359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:09.191287 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:09.309834 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1361/2743] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:30:09 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:30:09.314490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:09.324483 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74c774-ebd1-4330-86af-becb8e1827d7 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:09.329066 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:09.329711 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:09.329989 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:09.330267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:09.331030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:09.332601 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:09.342729 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1383/2744] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:30:09.346562 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:09.356044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa57b-23ba-402d-b0af-def6ffee314a admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:09.361086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:09.361950 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:09.362226 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:09.362501 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] PATH_INFO: `/v3/projects/a2b9f0dfc207405aa8cb1e09982f3de8/users/86ad00ef733348e2931d42872772f58b/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:09.377084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b9f0dfc207405aa8cb1e09982f3de8, user_id=86ad00ef733348e2931d42872772f58b, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:09.379734 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:09.446273 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1362/2745] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:30:09 2022] PUT /identity/v3/projects/a2b9f0dfc207405aa8cb1e09982f3de8/users/86ad00ef733348e2931d42872772f58b/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:30:09.450209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:09.461313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62e47-082b-466f-9dd0-51d78ec9400e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:09.516043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ce32d-dea4-4f53-8b74-c92d065f909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:09.516707 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ce32d-dea4-4f53-8b74-c92d065f909a admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:09.516988 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ce32d-dea4-4f53-8b74-c92d065f909a admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:09.517262 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ce32d-dea4-4f53-8b74-c92d065f909a admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:09.517993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ce32d-dea4-4f53-8b74-c92d065f909a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:09.519575 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ce32d-dea4-4f53-8b74-c92d065f909a admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:09.529219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1384/2746] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:30:09.533643 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:09.543579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53325-5477-4b07-8a7a-720984b50e63 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:09.548254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:09.549117 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:09.549393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:09.549662 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] PATH_INFO: `/v3/projects/a2b9f0dfc207405aa8cb1e09982f3de8/users/86ad00ef733348e2931d42872772f58b/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:09.551626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b9f0dfc207405aa8cb1e09982f3de8, user_id=86ad00ef733348e2931d42872772f58b, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:09.554213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:09.564744 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1363/2747] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:30:09 2022] PUT /identity/v3/projects/a2b9f0dfc207405aa8cb1e09982f3de8/users/86ad00ef733348e2931d42872772f58b/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:09.575636 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbf2f-1ff2-4487-9e58-061c391c3937 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:09.576523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbf2f-1ff2-4487-9e58-061c391c3937 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:09.576823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbf2f-1ff2-4487-9e58-061c391c3937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:09.603512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-1aebbf2f-1ff2-4487-9e58-061c391c3937 None None] MFA Rules not processed for user `86ad00ef733348e2931d42872772f58b`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:09.604704 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-1aebbf2f-1ff2-4487-9e58-061c391c3937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:09.670298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1385/2748] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:09.682160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:09.683883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:09.740565 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a72e-f2ab-4d8f-8cee-deeed43dfea3 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:09.744143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9f827-3aef-4ec8-8b52-e10b785c3909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:09.744772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9f827-3aef-4ec8-8b52-e10b785c3909 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:09.745050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9f827-3aef-4ec8-8b52-e10b785c3909 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:09.745323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9f827-3aef-4ec8-8b52-e10b785c3909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:09.798831 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9f827-3aef-4ec8-8b52-e10b785c3909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:09.800245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9f827-3aef-4ec8-8b52-e10b785c3909 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:09.808702 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1364/2749] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:30:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:30:14.023060 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbf2f-1ff2-4487-9e58-061c391c3937 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:14.084986 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbf2f-1ff2-4487-9e58-061c391c3937 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:14.089590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:14.090454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:14.090764 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:14.091037 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] PATH_INFO: `/v3/users/8bd784b3d45e4129901409c7f645cf75` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:14.093081 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd784b3d45e4129901409c7f645cf75)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:14.095021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:14.301812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd784b3d45e4129901409c7f645cf75'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:14.302405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd784b3d45e4129901409c7f645cf75'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:14.309530 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd784b3d45e4129901409c7f645cf75'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:14.384046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd784b3d45e4129901409c7f645cf75'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:14.384667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd784b3d45e4129901409c7f645cf75'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:14.402993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1386/2750] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:30:14 2022] DELETE /identity/v3/users/8bd784b3d45e4129901409c7f645cf75 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:14.407761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:14.408257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:14.408400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:14.425844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:30:14.427086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:14.488697 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1365/2751] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:30:14.499008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:14.500435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:14.556833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40c7ea-5eb0-4b9d-8d76-bc5f5420cc0f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:14.560899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:14.561555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:14.561833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:14.562105 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:14.571278 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:14.572697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:14.582428 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1387/2752] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:30:15.060203 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:15.061881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:15.077183 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db818d77-bbfb-45b9-9bd4-7bea78afbaaf None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:15.081302 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:15.082224 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:15.082509 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:15.082820 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] PATH_INFO: `/v3/projects/aee9a6954c284e108d6da83cc7afaea0` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:15.084192 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee9a6954c284e108d6da83cc7afaea0)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:15.086144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:15.228091 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee9a6954c284e108d6da83cc7afaea0', 'request_id': 'req-38109382-1607-46be-b985-4c1dc003bbfc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.308641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee9a6954c284e108d6da83cc7afaea0', 'request_id': 'req-38109382-1607-46be-b985-4c1dc003bbfc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.315158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee9a6954c284e108d6da83cc7afaea0', 'request_id': 'req-38109382-1607-46be-b985-4c1dc003bbfc'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.328666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] The token cache is being invalidate because project aee9a6954c284e108d6da83cc7afaea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:30:15.328666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.328666 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.330376 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1366/2753] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:30:15 2022] DELETE /identity/v3/projects/aee9a6954c284e108d6da83cc7afaea0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:15.334452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:15.344416 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7f0a1-bf44-4e99-8e49-8608d03013ce service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:15.404090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:15.404981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:15.405291 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:15.405570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] PATH_INFO: `/v3/users/86ad00ef733348e2931d42872772f58b` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:15.406823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ad00ef733348e2931d42872772f58b)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:15.408763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:15.668632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ad00ef733348e2931d42872772f58b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.668632 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ad00ef733348e2931d42872772f58b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.675030 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ad00ef733348e2931d42872772f58b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.772805 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ad00ef733348e2931d42872772f58b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.773467 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ad00ef733348e2931d42872772f58b'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:15.795564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1388/2754] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:30:15 2022] DELETE /identity/v3/users/86ad00ef733348e2931d42872772f58b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:16.254600 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:16.256147 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:16.270180 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38109382-1607-46be-b985-4c1dc003bbfc admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:16.330288 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:16.331196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:16.331482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:16.331759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] PATH_INFO: `/v3/projects/a2b9f0dfc207405aa8cb1e09982f3de8` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:16.332973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b9f0dfc207405aa8cb1e09982f3de8)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:16.334908 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:16.473755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b9f0dfc207405aa8cb1e09982f3de8', 'request_id': 'req-44c01c95-756a-4466-b9f8-e6f64c1080c7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:16.565100 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b9f0dfc207405aa8cb1e09982f3de8', 'request_id': 'req-44c01c95-756a-4466-b9f8-e6f64c1080c7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:16.571008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b9f0dfc207405aa8cb1e09982f3de8', 'request_id': 'req-44c01c95-756a-4466-b9f8-e6f64c1080c7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:16.582641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] The token cache is being invalidate because project a2b9f0dfc207405aa8cb1e09982f3de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:30:16.582934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:16.583558 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:30:16.585093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1367/2755] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:30:16 2022] DELETE /identity/v3/projects/a2b9f0dfc207405aa8cb1e09982f3de8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:30:46.443780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:30:46.445113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:46.517376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b6525-d1a0-497e-a1b7-92e1a4da412b admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:30:46.580396 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9aff6-466d-44e3-81b8-5f7630fec93d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:30:46.581173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9aff6-466d-44e3-81b8-5f7630fec93d service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:30:46.581456 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9aff6-466d-44e3-81b8-5f7630fec93d service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:30:46.581727 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9aff6-466d-44e3-81b8-5f7630fec93d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:30:46.583600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c8e9aff6-466d-44e3-81b8-5f7630fec93d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:30:46.640919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9aff6-466d-44e3-81b8-5f7630fec93d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:30:46.642897 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9aff6-466d-44e3-81b8-5f7630fec93d service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:30:46.652670 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1389/2756] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:31:05.139651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:31:05.141161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:05.158341 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c01c95-756a-4466-b9f8-e6f64c1080c7 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:31:05.164129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:31:05.164818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:31:05.165101 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:31:05.165381 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:31:05.167906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:05.182301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:31:05.183994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:31:05.196023 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1368/2757] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:31:10.357356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:31:10.359380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:31:10.359380 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:31:10.375833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] MFA Rules not processed for user `211572ee7ab5422981422eaed6341657`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:31:10.377084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:10.384225 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1390/2758] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:31:11.095747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:31:11.097211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:11.169488 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033257-ab8c-4273-92de-e7af3505edfc service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:31:11.175417 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:31:11.176071 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:31:11.176352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:31:11.176626 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:31:11.178393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:11.190902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:31:11.192508 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:31:11.203304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1369/2759] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:31:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:31:21.525938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:31:21.527732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:21.544311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599e34-5909-484b-a404-fddf061fdbdc None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:31:21.549854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:31:21.550515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:31:21.550890 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:31:21.551118 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:31:21.552918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:21.566135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:31:21.567863 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:31:21.579242 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1391/2760] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:31:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:31:25.274161 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:31:25.287049 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb62d4-b736-4aa3-9113-9d0f77b62b48 service placement] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:31:25.292577 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:31:25.293235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:31:25.293517 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:31:25.293822 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:31:25.295654 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:31:25.308731 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:31:25.310429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:31:25.321912 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1370/2761] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:31:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:32:48.943153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:32:48.944570 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:32:48.958173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397b52-dcee-4d9a-8a55-10fac4a39f83 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:32:48.963116 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:32:48.963748 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:32:48.964031 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:32:48.964313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:32:48.966005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:32:48.977708 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:32:48.979300 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:32:48.989993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1392/2762] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:32:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:05.318099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:05.319504 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:05.377221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9599447-125e-4b11-b666-15b53a69ddca service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:05.380715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:05.381361 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:05.381647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:05.381917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:05.383699 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:05.444594 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:05.446011 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:05.455374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1371/2763] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:09.080413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:09.081854 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:09.095583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845087-900d-4da6-a205-a9397bdb828f service placement] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:09.100064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:09.100931 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:09.101216 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:09.101491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] PATH_INFO: `/v3/users/211572ee7ab5422981422eaed6341657` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:09.102716 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=211572ee7ab5422981422eaed6341657)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:09.104621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:09.394788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211572ee7ab5422981422eaed6341657'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:09.395373 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211572ee7ab5422981422eaed6341657'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:09.404520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211572ee7ab5422981422eaed6341657'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:09.496142 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211572ee7ab5422981422eaed6341657'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:09.496753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-00200f4f-392a-4cf4-ab72-92398f330afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211572ee7ab5422981422eaed6341657'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:09.515946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1393/2764] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:09 2022] DELETE /identity/v3/users/211572ee7ab5422981422eaed6341657 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:09.792758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:09.803245 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d025dd9-2a8c-4ac6-86db-40e9579265fa service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:09.858994 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:09.860053 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:09.860333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:09.860616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] PATH_INFO: `/v3/projects/7ae2325a87da4c5f8179a77fbd3d8748` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:09.861780 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae2325a87da4c5f8179a77fbd3d8748)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:09.863694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:10.017177 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae2325a87da4c5f8179a77fbd3d8748', 'request_id': 'req-d14c985c-896c-4677-ad07-5f4a65a02ec7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:10.113384 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae2325a87da4c5f8179a77fbd3d8748', 'request_id': 'req-d14c985c-896c-4677-ad07-5f4a65a02ec7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:10.119723 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae2325a87da4c5f8179a77fbd3d8748', 'request_id': 'req-d14c985c-896c-4677-ad07-5f4a65a02ec7'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:10.131650 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] The token cache is being invalidate because project 7ae2325a87da4c5f8179a77fbd3d8748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:10.135896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:10.135896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-d14c985c-896c-4677-ad07-5f4a65a02ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:10.135896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1372/2765] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:09 2022] DELETE /identity/v3/projects/7ae2325a87da4c5f8179a77fbd3d8748 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:10.138968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30752e53-1d3b-46f3-8ea9-5ffdc0a734e0 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.139435 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30752e53-1d3b-46f3-8ea9-5ffdc0a734e0 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.139553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30752e53-1d3b-46f3-8ea9-5ffdc0a734e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.158141 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-30752e53-1d3b-46f3-8ea9-5ffdc0a734e0 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:10.159442 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-30752e53-1d3b-46f3-8ea9-5ffdc0a734e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:10.218209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1394/2766] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:10.226503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ecc2-a70d-4178-b5e1-f243ba191de1 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.226911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ecc2-a70d-4178-b5e1-f243ba191de1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.227193 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ecc2-a70d-4178-b5e1-f243ba191de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.245943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-03c5ecc2-a70d-4178-b5e1-f243ba191de1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:10.247194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-03c5ecc2-a70d-4178-b5e1-f243ba191de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:10.255990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1373/2767] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:10.260334 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30752e53-1d3b-46f3-8ea9-5ffdc0a734e0 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:10.270139 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30752e53-1d3b-46f3-8ea9-5ffdc0a734e0 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:10.274731 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:10.275660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.275937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.276207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.276923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:33:10.277253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:10.278858 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:10.290476 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1395/2768] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:33:10.294923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ecc2-a70d-4178-b5e1-f243ba191de1 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:10.305422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ecc2-a70d-4178-b5e1-f243ba191de1 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:10.310266 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:10.310884 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.311165 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.311435 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.312126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:10.314637 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:10.416237 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1374/2769] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:10 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:10.419970 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:10.433100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940184b-1282-4925-a0d3-d7c3cfdfcbed admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:10.489534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:10.490202 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.490481 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.490784 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.491469 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:10.493364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:10.597051 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1396/2770] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:10 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:10.601087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:10.611823 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae48d-f639-4ed7-8e92-5dd9fbe95e7d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:10.616348 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:10.616997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.617271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.617538 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.618255 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:10.619857 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:10.629511 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1375/2771] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:33:10.633693 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:10.643839 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564054-817d-4530-a051-aac2e1903323 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:10.648580 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee273c-3075-432b-9aa0-ad201c61db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:10.649226 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee273c-3075-432b-9aa0-ad201c61db25 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.649507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee273c-3075-432b-9aa0-ad201c61db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.649780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee273c-3075-432b-9aa0-ad201c61db25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.650814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee273c-3075-432b-9aa0-ad201c61db25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:10.652400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee273c-3075-432b-9aa0-ad201c61db25 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:10.662812 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1397/2772] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:10.666793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:10.677338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617cfab-4751-4539-be0e-cfe7f1485327 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:10.681917 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:10.682815 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.683093 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.683368 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] PATH_INFO: `/v3/projects/0ad46fc585b7423a8059748bed4de0ce/users/fafc4f54aa9f402d850e2b908667ceeb/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.697601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad46fc585b7423a8059748bed4de0ce, user_id=fafc4f54aa9f402d850e2b908667ceeb, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:10.700426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:10.791311 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1376/2773] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:10 2022] PUT /identity/v3/projects/0ad46fc585b7423a8059748bed4de0ce/users/fafc4f54aa9f402d850e2b908667ceeb/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:10.802995 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd1e27-5234-4998-bd95-50f2e3b22296 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.803308 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd1e27-5234-4998-bd95-50f2e3b22296 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.803586 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd1e27-5234-4998-bd95-50f2e3b22296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.831520 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-18fd1e27-5234-4998-bd95-50f2e3b22296 None None] MFA Rules not processed for user `fafc4f54aa9f402d850e2b908667ceeb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:10.832783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-18fd1e27-5234-4998-bd95-50f2e3b22296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:10.895831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1398/2774] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:10.900657 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:10.963534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc4169-eb20-483c-8792-c5ac1010bac0 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:10.968077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:10.969392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:10.969676 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:10.969947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:10.970647 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:10.972525 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:11.098396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1377/2775] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:10 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:11.102309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd1e27-5234-4998-bd95-50f2e3b22296 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:11.115441 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd1e27-5234-4998-bd95-50f2e3b22296 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:11.170306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:11.171017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.171188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.171461 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.172325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:11.174474 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:11.267736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1399/2776] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:11 2022] POST /identity/v3/users => generated 309 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:11.271810 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:11.282400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b665c7-0145-4150-acc9-4c3260dbdb47 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:11.287064 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:11.290385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.290385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.290385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.290385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:11.290878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:11.301289 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1378/2777] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:11.305527 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:11.315927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90ce3-62ab-428e-b718-fdb603ce0e77 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:11.320594 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:11.321458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.321736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.322008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] PATH_INFO: `/v3/projects/32200e9e6c054f68a936a996f9d3e154/users/e491b38a9f4b40dfb4816690ec31f631/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.336870 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32200e9e6c054f68a936a996f9d3e154, user_id=e491b38a9f4b40dfb4816690ec31f631, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:11.339544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:11.415792 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1400/2778] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:11 2022] PUT /identity/v3/projects/32200e9e6c054f68a936a996f9d3e154/users/e491b38a9f4b40dfb4816690ec31f631/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:11.419714 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:11.429829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28234b-f889-4b44-9966-203accd5b597 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:11.485154 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb7333-bddb-4948-857e-b8ffe583f4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:11.485848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb7333-bddb-4948-857e-b8ffe583f4ef admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.486149 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb7333-bddb-4948-857e-b8ffe583f4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.486425 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb7333-bddb-4948-857e-b8ffe583f4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.487187 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb7333-bddb-4948-857e-b8ffe583f4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:11.488806 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb7333-bddb-4948-857e-b8ffe583f4ef admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:11.498291 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1379/2779] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:11.502975 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:11.513366 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7180b-4325-4076-81f2-a841b3813c10 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:11.519131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:11.520003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.520312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.520587 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] PATH_INFO: `/v3/projects/32200e9e6c054f68a936a996f9d3e154/users/e491b38a9f4b40dfb4816690ec31f631/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.522557 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32200e9e6c054f68a936a996f9d3e154, user_id=e491b38a9f4b40dfb4816690ec31f631, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:11.525674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:11.536311 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1401/2780] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:11 2022] PUT /identity/v3/projects/32200e9e6c054f68a936a996f9d3e154/users/e491b38a9f4b40dfb4816690ec31f631/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:11.554139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bfbf9-940b-49cd-9d51-93bde58b385e None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.554428 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bfbf9-940b-49cd-9d51-93bde58b385e None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.554757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bfbf9-940b-49cd-9d51-93bde58b385e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.582387 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-902bfbf9-940b-49cd-9d51-93bde58b385e None None] MFA Rules not processed for user `e491b38a9f4b40dfb4816690ec31f631`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:11.583614 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-902bfbf9-940b-49cd-9d51-93bde58b385e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:11.649678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1380/2781] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:11.660584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:11.662335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:11.719207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44afb8b-b6ba-4083-b7e4-2af0fa02d1c1 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:11.722902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e143d7-2aff-4f9b-b194-6beabe3e4465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:11.723545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e143d7-2aff-4f9b-b194-6beabe3e4465 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.723821 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e143d7-2aff-4f9b-b194-6beabe3e4465 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.724092 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e143d7-2aff-4f9b-b194-6beabe3e4465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.733589 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e143d7-2aff-4f9b-b194-6beabe3e4465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:11.735592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e143d7-2aff-4f9b-b194-6beabe3e4465 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:11.745104 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1402/2782] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:11.888934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bfbf9-940b-49cd-9d51-93bde58b385e None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:11.949233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bfbf9-940b-49cd-9d51-93bde58b385e None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:11.954673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:11.955545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:11.955827 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:11.956102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] PATH_INFO: `/v3/users/fafc4f54aa9f402d850e2b908667ceeb` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:11.957303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafc4f54aa9f402d850e2b908667ceeb)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:11.959253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:12.121407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafc4f54aa9f402d850e2b908667ceeb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:12.227185 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafc4f54aa9f402d850e2b908667ceeb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:12.239253 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafc4f54aa9f402d850e2b908667ceeb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:12.239878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafc4f54aa9f402d850e2b908667ceeb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:12.240481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafc4f54aa9f402d850e2b908667ceeb'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:12.253166 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1381/2783] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:11 2022] DELETE /identity/v3/users/fafc4f54aa9f402d850e2b908667ceeb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:12.257705 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:12.258175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:12.258318 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:12.277028 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:12.278212 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:12.338468 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1403/2784] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:12.351790 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:12.355524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:12.413530 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013010f6-bcb4-4a9b-8bb7-a2b30a94c84d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:12.417242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:12.417868 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:12.418148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:12.418421 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:12.428084 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:12.429506 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:12.440065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1382/2785] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:12.915019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:12.916449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:12.928981 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398a6b-2c20-4bb6-93f8-de6349c54792 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:12.933600 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:12.934458 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:12.934775 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:12.935048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] PATH_INFO: `/v3/projects/0ad46fc585b7423a8059748bed4de0ce` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:12.936233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad46fc585b7423a8059748bed4de0ce)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:12.938235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:13.084383 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad46fc585b7423a8059748bed4de0ce', 'request_id': 'req-c72d42d4-7a99-4c65-a730-a51c88a16877'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.089695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad46fc585b7423a8059748bed4de0ce', 'request_id': 'req-c72d42d4-7a99-4c65-a730-a51c88a16877'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.147217 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad46fc585b7423a8059748bed4de0ce', 'request_id': 'req-c72d42d4-7a99-4c65-a730-a51c88a16877'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.163573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] The token cache is being invalidate because project 0ad46fc585b7423a8059748bed4de0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:13.163573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.163573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.163573 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1404/2786] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:12 2022] DELETE /identity/v3/projects/0ad46fc585b7423a8059748bed4de0ce => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:13.166343 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:13.176529 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398276-20ae-4a27-885d-b99224437108 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:13.233437 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:13.234906 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:13.235221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:13.235507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] PATH_INFO: `/v3/users/e491b38a9f4b40dfb4816690ec31f631` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:13.236728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e491b38a9f4b40dfb4816690ec31f631)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:13.238663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:13.405323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e491b38a9f4b40dfb4816690ec31f631'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.472489 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e491b38a9f4b40dfb4816690ec31f631'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.485075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e491b38a9f4b40dfb4816690ec31f631'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.485759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e491b38a9f4b40dfb4816690ec31f631'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.486378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-8f883dd5-8a70-4302-bb4a-97199dff542d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e491b38a9f4b40dfb4816690ec31f631'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:13.498269 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1383/2787] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:13 2022] DELETE /identity/v3/users/e491b38a9f4b40dfb4816690ec31f631 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:13.874274 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:13.877082 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:13.895094 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d42d4-7a99-4c65-a730-a51c88a16877 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:13.959343 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:13.960227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:13.960507 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:13.960786 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] PATH_INFO: `/v3/projects/32200e9e6c054f68a936a996f9d3e154` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:13.961976 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=32200e9e6c054f68a936a996f9d3e154)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:13.963898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:14.113109 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32200e9e6c054f68a936a996f9d3e154', 'request_id': 'req-28b5782c-b86f-433d-8e25-dbe909b92dbf'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:14.118874 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32200e9e6c054f68a936a996f9d3e154', 'request_id': 'req-28b5782c-b86f-433d-8e25-dbe909b92dbf'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:14.210100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32200e9e6c054f68a936a996f9d3e154', 'request_id': 'req-28b5782c-b86f-433d-8e25-dbe909b92dbf'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:14.222234 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] The token cache is being invalidate because project 32200e9e6c054f68a936a996f9d3e154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:14.222521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:14.223222 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-28b5782c-b86f-433d-8e25-dbe909b92dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:14.224746 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1405/2788] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:13 2022] DELETE /identity/v3/projects/32200e9e6c054f68a936a996f9d3e154 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:14.229896 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a40d-52d5-4cf8-b28e-56c1132d8fc3 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.230360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a40d-52d5-4cf8-b28e-56c1132d8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.230456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a40d-52d5-4cf8-b28e-56c1132d8fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.248205 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-ef14a40d-52d5-4cf8-b28e-56c1132d8fc3 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:14.249400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-ef14a40d-52d5-4cf8-b28e-56c1132d8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:14.308165 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1384/2789] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:14.316410 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14b15-ab1c-44ce-a670-c30696aca691 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.316640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14b15-ab1c-44ce-a670-c30696aca691 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.316921 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14b15-ab1c-44ce-a670-c30696aca691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.336203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-3ac14b15-ab1c-44ce-a670-c30696aca691 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:14.337405 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3ac14b15-ab1c-44ce-a670-c30696aca691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:14.345837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1406/2790] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:14.350201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14a40d-52d5-4cf8-b28e-56c1132d8fc3 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:14.359978 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14a40d-52d5-4cf8-b28e-56c1132d8fc3 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:14.364675 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144a31-de05-443e-b390-03797607b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:14.365324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144a31-de05-443e-b390-03797607b51b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.365603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144a31-de05-443e-b390-03797607b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.365875 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144a31-de05-443e-b390-03797607b51b admin admin] PATH_INFO: `/v3/domains` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.366583 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144a31-de05-443e-b390-03797607b51b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:33:14.367040 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144a31-de05-443e-b390-03797607b51b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:14.368610 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144a31-de05-443e-b390-03797607b51b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:14.380383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1385/2791] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:33:14.384952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14b15-ab1c-44ce-a670-c30696aca691 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:14.396364 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14b15-ab1c-44ce-a670-c30696aca691 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:14.401272 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:14.401923 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.402201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.402475 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.403219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:14.405132 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:14.485774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1407/2792] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:14 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:14.489943 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144a31-de05-443e-b390-03797607b51b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:14.500445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144a31-de05-443e-b390-03797607b51b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:14.555534 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:14.556195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.556481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.556757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.557446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:14.559369 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:14.690630 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1386/2793] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:14 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:14.694639 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:14.704824 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7b3b-0e8e-4a30-9f24-bd04f95ff681 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:14.709292 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:14.709941 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.710219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.710491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.711248 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:14.712816 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:14.722903 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1408/2794] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:14.726728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:14.737303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d6a0b-d346-4d57-9bb1-f4c3dc2a3ea6 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:14.742132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d0cca-1a92-475a-970c-415004180b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:14.742839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0cca-1a92-475a-970c-415004180b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.743120 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0cca-1a92-475a-970c-415004180b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.743395 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0cca-1a92-475a-970c-415004180b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.744115 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0cca-1a92-475a-970c-415004180b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:14.745736 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0cca-1a92-475a-970c-415004180b7e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:14.756174 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1387/2795] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:33:14.760513 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:14.770827 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baa63a-b623-4501-b010-affd5229516e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:14.775498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:14.776355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.776629 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.776899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] PATH_INFO: `/v3/projects/8c39da0b15c34591bc64a5a7f3a5bca9/users/18285eee6e18452db30547989784ff99/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.791584 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c39da0b15c34591bc64a5a7f3a5bca9, user_id=18285eee6e18452db30547989784ff99, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:14.794189 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:14.878957 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1409/2796] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:14 2022] PUT /identity/v3/projects/8c39da0b15c34591bc64a5a7f3a5bca9/users/18285eee6e18452db30547989784ff99/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:14.890494 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf3a0-4a37-48c4-b500-b63743310c01 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:14.890850 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf3a0-4a37-48c4-b500-b63743310c01 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:14.891129 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf3a0-4a37-48c4-b500-b63743310c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:14.917628 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-89ecf3a0-4a37-48c4-b500-b63743310c01 None None] MFA Rules not processed for user `18285eee6e18452db30547989784ff99`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:14.918854 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-89ecf3a0-4a37-48c4-b500-b63743310c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:14.981427 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1388/2797] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:14.987010 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:15.047643 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40984b5d-4eb4-4622-a3c7-b14dce420f65 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:15.052351 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:15.053008 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.053314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.053590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.054449 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:15.056374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:15.165191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1410/2798] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:14 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:33:15.169018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf3a0-4a37-48c4-b500-b63743310c01 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:15.180360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf3a0-4a37-48c4-b500-b63743310c01 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:15.233758 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:15.235122 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.235321 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.235593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] PATH_INFO: `/v3/users` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.236401 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:15.238206 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:15.335757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1389/2799] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:15 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:15.339794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:15.351147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312d88-66f1-4185-b2cd-44f010847c1e admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:15.355756 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:15.356431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.356712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.356983 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.357699 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:15.359323 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:15.369576 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1411/2800] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:33:15.373593 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:15.383483 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bedc17-48ee-45cf-a6d7-3bfa8a9eaf02 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:15.388007 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:15.388907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.389186 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.389460 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] PATH_INFO: `/v3/projects/609ac8a7bc53400cbbd5ac0f9a194cf5/users/29ab42ba6a2c46ac9d5a85d5a45755c0/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.405792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] RBAC: Authorizing `identity:create_grant(project_id=609ac8a7bc53400cbbd5ac0f9a194cf5, user_id=29ab42ba6a2c46ac9d5a85d5a45755c0, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:15.409175 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:15.500805 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1390/2801] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:15 2022] PUT /identity/v3/projects/609ac8a7bc53400cbbd5ac0f9a194cf5/users/29ab42ba6a2c46ac9d5a85d5a45755c0/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:33:15.504664 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:15.516509 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f0375-9d0b-49a1-aa4b-dfd7892874c2 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:15.574982 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381202ae-f735-4a25-bcda-9d768025cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:15.575665 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381202ae-f735-4a25-bcda-9d768025cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.575952 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381202ae-f735-4a25-bcda-9d768025cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.576230 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381202ae-f735-4a25-bcda-9d768025cc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.576993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381202ae-f735-4a25-bcda-9d768025cc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:15.579208 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381202ae-f735-4a25-bcda-9d768025cc39 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:15.589240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1412/2802] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:15.594128 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:15.604349 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3910-f681-48d3-86f9-0f526ff6312f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:15.608907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:15.609808 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.610086 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.610357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] PATH_INFO: `/v3/projects/609ac8a7bc53400cbbd5ac0f9a194cf5/users/29ab42ba6a2c46ac9d5a85d5a45755c0/roles/641f3a975368436eac3de51f3605c569` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.612362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=609ac8a7bc53400cbbd5ac0f9a194cf5, user_id=29ab42ba6a2c46ac9d5a85d5a45755c0, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:15.615863 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:15.625103 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1391/2803] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:15 2022] PUT /identity/v3/projects/609ac8a7bc53400cbbd5ac0f9a194cf5/users/29ab42ba6a2c46ac9d5a85d5a45755c0/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:15.635768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46042e9d-b0d5-4661-b9d7-beb8cf747b79 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.636062 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46042e9d-b0d5-4661-b9d7-beb8cf747b79 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.636347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46042e9d-b0d5-4661-b9d7-beb8cf747b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.663772 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-46042e9d-b0d5-4661-b9d7-beb8cf747b79 None None] MFA Rules not processed for user `29ab42ba6a2c46ac9d5a85d5a45755c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:15.664994 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-46042e9d-b0d5-4661-b9d7-beb8cf747b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:15.731703 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1413/2804] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:15.751856 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:15.753471 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:15.810159 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7dea2-57f6-48ca-9d20-a89fde09c0fd admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:15.813924 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bbe45-54dc-4dbb-b967-a866a6d41a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:15.814570 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bbe45-54dc-4dbb-b967-a866a6d41a29 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:15.814883 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bbe45-54dc-4dbb-b967-a866a6d41a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:15.815157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bbe45-54dc-4dbb-b967-a866a6d41a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:15.824001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bbe45-54dc-4dbb-b967-a866a6d41a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:15.825420 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bbe45-54dc-4dbb-b967-a866a6d41a29 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:15.834712 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1392/2805] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:16.328070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46042e9d-b0d5-4661-b9d7-beb8cf747b79 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:16.391567 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46042e9d-b0d5-4661-b9d7-beb8cf747b79 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:16.396079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:16.397013 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:16.397298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:16.397574 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] PATH_INFO: `/v3/users/18285eee6e18452db30547989784ff99` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:16.398796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18285eee6e18452db30547989784ff99)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:16.400947 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:16.618108 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18285eee6e18452db30547989784ff99'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:16.618735 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18285eee6e18452db30547989784ff99'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:16.625950 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18285eee6e18452db30547989784ff99'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:16.729736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18285eee6e18452db30547989784ff99'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:16.730348 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18285eee6e18452db30547989784ff99'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:16.752448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1414/2806] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:16 2022] DELETE /identity/v3/users/18285eee6e18452db30547989784ff99 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:16.756911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:16.757456 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:16.764026 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:16.776292 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:16.777482 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:16.835275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1393/2807] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:16.845005 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:16.846384 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:16.902853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48441a-eda9-42b8-95d8-bd0612381f79 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:16.906455 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:16.907119 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:16.907395 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:16.907667 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:16.916723 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:16.918184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:16.928294 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1415/2808] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:17.395275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:17.396771 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:17.409792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3de7-8315-4bd5-b14e-574be82cf3dc None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:17.414378 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:17.415257 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:17.415537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:17.415811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] PATH_INFO: `/v3/projects/8c39da0b15c34591bc64a5a7f3a5bca9` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:17.416992 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c39da0b15c34591bc64a5a7f3a5bca9)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:17.418905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:17.581005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c39da0b15c34591bc64a5a7f3a5bca9', 'request_id': 'req-9ee4ef32-a445-4a2a-867b-b761df10c4df'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:17.739979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c39da0b15c34591bc64a5a7f3a5bca9', 'request_id': 'req-9ee4ef32-a445-4a2a-867b-b761df10c4df'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:17.745946 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c39da0b15c34591bc64a5a7f3a5bca9', 'request_id': 'req-9ee4ef32-a445-4a2a-867b-b761df10c4df'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:17.758012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] The token cache is being invalidate because project 8c39da0b15c34591bc64a5a7f3a5bca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:17.758636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:17.758935 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:17.760466 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1394/2809] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:17 2022] DELETE /identity/v3/projects/8c39da0b15c34591bc64a5a7f3a5bca9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:17.764648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:17.775545 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8336ae-86f4-4e86-a07c-51651794493d service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:17.832338 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:17.833097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:17.833373 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:17.833640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] PATH_INFO: `/v3/users/29ab42ba6a2c46ac9d5a85d5a45755c0` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:17.834848 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ab42ba6a2c46ac9d5a85d5a45755c0)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:17.836741 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:18.046720 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ab42ba6a2c46ac9d5a85d5a45755c0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:18.047376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ab42ba6a2c46ac9d5a85d5a45755c0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:18.055124 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ab42ba6a2c46ac9d5a85d5a45755c0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:18.230162 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ab42ba6a2c46ac9d5a85d5a45755c0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:18.230892 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-cf496a90-34a6-4b61-81ff-ef92eec2c98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ab42ba6a2c46ac9d5a85d5a45755c0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:18.248549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1416/2810] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:17 2022] DELETE /identity/v3/users/29ab42ba6a2c46ac9d5a85d5a45755c0 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:18.697567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:18.699001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:18.714081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4ef32-a445-4a2a-867b-b761df10c4df admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:18.771905 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:18.772681 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:18.772965 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:18.773234 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] PATH_INFO: `/v3/projects/609ac8a7bc53400cbbd5ac0f9a194cf5` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:18.774392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609ac8a7bc53400cbbd5ac0f9a194cf5)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:18.776563 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:18.911858 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609ac8a7bc53400cbbd5ac0f9a194cf5', 'request_id': 'req-16cc034c-4883-430e-a129-b02a6e748603'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:19.030958 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609ac8a7bc53400cbbd5ac0f9a194cf5', 'request_id': 'req-16cc034c-4883-430e-a129-b02a6e748603'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:19.036890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609ac8a7bc53400cbbd5ac0f9a194cf5', 'request_id': 'req-16cc034c-4883-430e-a129-b02a6e748603'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:19.048492 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] The token cache is being invalidate because project 609ac8a7bc53400cbbd5ac0f9a194cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:19.048792 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:19.049429 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-16cc034c-4883-430e-a129-b02a6e748603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:19.051303 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1395/2811] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:18 2022] DELETE /identity/v3/projects/609ac8a7bc53400cbbd5ac0f9a194cf5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:19.056794 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb943d-725b-4b6f-9433-fd456082368f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.064446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb943d-725b-4b6f-9433-fd456082368f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.064446 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb943d-725b-4b6f-9433-fd456082368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.078540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-b4eb943d-725b-4b6f-9433-fd456082368f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:19.079918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-b4eb943d-725b-4b6f-9433-fd456082368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:19.138029 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1417/2812] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:19.147077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abfd64-b3ee-4733-8fc0-28d0001c2482 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.147442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abfd64-b3ee-4733-8fc0-28d0001c2482 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.147716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abfd64-b3ee-4733-8fc0-28d0001c2482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.166413 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-40abfd64-b3ee-4733-8fc0-28d0001c2482 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:19.167632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-40abfd64-b3ee-4733-8fc0-28d0001c2482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:19.176196 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1396/2813] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:33:19.180498 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb943d-725b-4b6f-9433-fd456082368f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:19.190207 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb943d-725b-4b6f-9433-fd456082368f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:19.194856 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:19.195537 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.195814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.196083 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.196796 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:33:19.197098 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:19.198696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:19.212089 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1418/2814] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:33:19.216515 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abfd64-b3ee-4733-8fc0-28d0001c2482 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:19.225957 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abfd64-b3ee-4733-8fc0-28d0001c2482 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:19.230557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:19.231225 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.231502 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.231776 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.232465 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:19.235003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:19.330418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1397/2815] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:19 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:19.334648 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:19.345168 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdd54c-d6f4-4f3a-9554-2fa6c9a2841d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:19.399368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:19.400033 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.400566 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.400845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.401523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:19.403450 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:19.489402 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1419/2816] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:19 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:19.493495 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:19.503907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3906-c37c-4a83-9d94-1e6194c26bf4 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:19.508686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:19.509374 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.509682 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.509962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.510814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:19.512414 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:19.523724 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1398/2817] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:19.527880 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:19.538227 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0a0dd-7c13-4f8f-afb3-2d02a429dee7 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:19.542850 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15416a-52ed-4d4d-8901-d500a0f98f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:19.543491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15416a-52ed-4d4d-8901-d500a0f98f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.543768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15416a-52ed-4d4d-8901-d500a0f98f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.544043 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15416a-52ed-4d4d-8901-d500a0f98f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.544763 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15416a-52ed-4d4d-8901-d500a0f98f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:19.546325 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15416a-52ed-4d4d-8901-d500a0f98f48 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:19.556011 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1420/2818] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:19.560081 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:19.570066 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33c794-1cdf-4753-9e9a-6c762e5bd16e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:19.574844 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:19.575713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.575995 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.576280 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] PATH_INFO: `/v3/projects/5fb3339bbbd340819d430b5fb2706185/users/7d87422a338240b7b0efb3109a75dfb8/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.591212 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb3339bbbd340819d430b5fb2706185, user_id=7d87422a338240b7b0efb3109a75dfb8, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:19.594386 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:19.713411 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1399/2819] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:19 2022] PUT /identity/v3/projects/5fb3339bbbd340819d430b5fb2706185/users/7d87422a338240b7b0efb3109a75dfb8/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:19.724522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bef9c-83ea-4dcc-84fb-91c653868d64 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.724814 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bef9c-83ea-4dcc-84fb-91c653868d64 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.725090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bef9c-83ea-4dcc-84fb-91c653868d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.751590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-4b1bef9c-83ea-4dcc-84fb-91c653868d64 None None] MFA Rules not processed for user `7d87422a338240b7b0efb3109a75dfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:19.752867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4b1bef9c-83ea-4dcc-84fb-91c653868d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:19.820077 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1421/2820] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:19.824582 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:19.906721 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06c31-76a8-466d-89e2-cce016ce7776 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:19.911444 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:19.912108 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:19.912392 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:19.912667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:19.913373 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:19.915433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.015545 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1400/2821] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:19 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:20.020858 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bef9c-83ea-4dcc-84fb-91c653868d64 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:20.033452 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bef9c-83ea-4dcc-84fb-91c653868d64 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:20.092413 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:20.093153 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.093355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.093662 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.094440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:20.096473 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.188571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1422/2822] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:20 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:20.192524 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:20.205851 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be970a16-dd00-4231-a53a-526f470a910e admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:20.213036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:20.214148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.214441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.214759 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.215486 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:20.217075 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.229416 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1401/2823] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:20.235607 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:20.246026 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c8d84-35a8-4f61-a06b-f75155aa31fc admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:20.251654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:20.252583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.252861 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.253138 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] PATH_INFO: `/v3/projects/3c7b25577d7649ad893785269ded29b6/users/f63bb7cbc93446b88d6a306c2a39cdfd/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.269210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7b25577d7649ad893785269ded29b6, user_id=f63bb7cbc93446b88d6a306c2a39cdfd, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:20.271953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.377173 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1423/2824] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:20 2022] PUT /identity/v3/projects/3c7b25577d7649ad893785269ded29b6/users/f63bb7cbc93446b88d6a306c2a39cdfd/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:33:20.381457 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:20.391839 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1db2f-7802-4bab-a513-2d45d0c9999f admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:20.455726 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89f4a4-5c87-416f-83de-94a36a516b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:20.456326 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89f4a4-5c87-416f-83de-94a36a516b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.456606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89f4a4-5c87-416f-83de-94a36a516b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.456881 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89f4a4-5c87-416f-83de-94a36a516b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.457604 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89f4a4-5c87-416f-83de-94a36a516b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:20.459221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89f4a4-5c87-416f-83de-94a36a516b04 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.471333 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1402/2825] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:20.475978 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:20.487133 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2d00b-ecc9-48f2-a024-2ee203807a10 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:20.493401 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:20.494502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.494822 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.495097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] PATH_INFO: `/v3/projects/3c7b25577d7649ad893785269ded29b6/users/f63bb7cbc93446b88d6a306c2a39cdfd/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.497666 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7b25577d7649ad893785269ded29b6, user_id=f63bb7cbc93446b88d6a306c2a39cdfd, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:20.501419 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.513755 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1424/2826] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:20 2022] PUT /identity/v3/projects/3c7b25577d7649ad893785269ded29b6/users/f63bb7cbc93446b88d6a306c2a39cdfd/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:20.524601 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe671b-aa78-40c8-95d3-e2bb90cb83f9 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.526713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe671b-aa78-40c8-95d3-e2bb90cb83f9 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.526713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe671b-aa78-40c8-95d3-e2bb90cb83f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.560390 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-fdfe671b-aa78-40c8-95d3-e2bb90cb83f9 None None] MFA Rules not processed for user `f63bb7cbc93446b88d6a306c2a39cdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:20.561664 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fdfe671b-aa78-40c8-95d3-e2bb90cb83f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:20.631001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1403/2827] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:20.645627 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:20.648471 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:20.715645 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944981-67ae-4b77-bce2-c56e97341960 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:20.719966 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:20.720616 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.720898 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.721175 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.731808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:20.733374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.748203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1425/2828] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:20.911616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe671b-aa78-40c8-95d3-e2bb90cb83f9 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:20.921262 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe671b-aa78-40c8-95d3-e2bb90cb83f9 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:20.925656 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f34f49-1e10-469a-a0cd-e2231683a2ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:20.926301 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34f49-1e10-469a-a0cd-e2231683a2ea service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:20.926584 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34f49-1e10-469a-a0cd-e2231683a2ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:20.926890 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34f49-1e10-469a-a0cd-e2231683a2ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:20.982240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34f49-1e10-469a-a0cd-e2231683a2ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:20.983597 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34f49-1e10-469a-a0cd-e2231683a2ea service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:20.992268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1404/2829] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:21.504614 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:21.570279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be675b-536e-4ddb-96f9-901bf5f337fb service cinder] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:21.574902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:21.575752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:21.576027 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:21.576298 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] PATH_INFO: `/v3/users/7d87422a338240b7b0efb3109a75dfb8` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:21.577472 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d87422a338240b7b0efb3109a75dfb8)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:21.580195 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:21.817243 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d87422a338240b7b0efb3109a75dfb8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:21.817907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d87422a338240b7b0efb3109a75dfb8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:21.826998 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d87422a338240b7b0efb3109a75dfb8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:21.912201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d87422a338240b7b0efb3109a75dfb8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:21.912844 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d87422a338240b7b0efb3109a75dfb8'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:21.931448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1426/2830] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:21 2022] DELETE /identity/v3/users/7d87422a338240b7b0efb3109a75dfb8 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:21.935898 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:21.936399 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:21.936507 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:21.954195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:21.955407 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:22.013024 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1405/2831] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:22.023457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:22.024845 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:22.082939 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef2b3-cd5d-49b3-9088-b3428a0a57d4 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:22.086581 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:22.087263 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:22.087540 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:22.087811 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:22.097315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:22.098860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:22.108269 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1427/2832] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:22.520533 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:22.521991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:22.535298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650b85a-1f6f-4076-805b-7f0c4733d57a None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:22.540058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:22.540926 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:22.541201 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:22.541470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] PATH_INFO: `/v3/projects/5fb3339bbbd340819d430b5fb2706185` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:22.543020 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb3339bbbd340819d430b5fb2706185)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:22.545039 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:22.716910 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb3339bbbd340819d430b5fb2706185', 'request_id': 'req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:22.819791 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb3339bbbd340819d430b5fb2706185', 'request_id': 'req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:22.825739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb3339bbbd340819d430b5fb2706185', 'request_id': 'req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:22.837620 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] The token cache is being invalidate because project 5fb3339bbbd340819d430b5fb2706185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:22.837915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:22.838568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:22.840312 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1406/2833] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:22 2022] DELETE /identity/v3/projects/5fb3339bbbd340819d430b5fb2706185 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:22.844375 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:22.854135 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb26fd-bb2e-41c7-b405-8ebef7b78b21 service neutron] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:22.910774 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:22.911642 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:22.911925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:22.912201 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] PATH_INFO: `/v3/users/f63bb7cbc93446b88d6a306c2a39cdfd` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:22.913394 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63bb7cbc93446b88d6a306c2a39cdfd)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:22.915331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:23.131615 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63bb7cbc93446b88d6a306c2a39cdfd'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:23.132356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63bb7cbc93446b88d6a306c2a39cdfd'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:23.139335 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63bb7cbc93446b88d6a306c2a39cdfd'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:23.215385 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63bb7cbc93446b88d6a306c2a39cdfd'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:23.216048 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-ecfcb832-2f40-49a5-b13f-a26850694e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63bb7cbc93446b88d6a306c2a39cdfd'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:23.235093 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1428/2834] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:22 2022] DELETE /identity/v3/users/f63bb7cbc93446b88d6a306c2a39cdfd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:23.896615 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:23.898070 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:23.913610 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8d42-909d-4d83-8e3a-7ec7107d299d admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:23.975443 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:23.976298 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:23.976579 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:23.976902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] PATH_INFO: `/v3/projects/3c7b25577d7649ad893785269ded29b6` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:23.978016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7b25577d7649ad893785269ded29b6)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:23.980044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:24.146981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7b25577d7649ad893785269ded29b6', 'request_id': 'req-9b3d5230-900d-48b0-93fe-e61bedc023c8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:24.255619 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7b25577d7649ad893785269ded29b6', 'request_id': 'req-9b3d5230-900d-48b0-93fe-e61bedc023c8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:24.261409 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7b25577d7649ad893785269ded29b6', 'request_id': 'req-9b3d5230-900d-48b0-93fe-e61bedc023c8'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:24.272785 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] The token cache is being invalidate because project 3c7b25577d7649ad893785269ded29b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:24.273068 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:24.273718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-9b3d5230-900d-48b0-93fe-e61bedc023c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:24.275523 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1407/2835] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:23 2022] DELETE /identity/v3/projects/3c7b25577d7649ad893785269ded29b6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:24.281943 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a822c7-3078-4a5c-9756-95c1fa23e5e4 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.282448 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a822c7-3078-4a5c-9756-95c1fa23e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.282554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a822c7-3078-4a5c-9756-95c1fa23e5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.299918 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-18a822c7-3078-4a5c-9756-95c1fa23e5e4 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:24.301128 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-18a822c7-3078-4a5c-9756-95c1fa23e5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:24.359593 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1429/2836] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:24.368389 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c19b-c4af-4fd1-b2a2-7a98c3e7009f None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.368673 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c19b-c4af-4fd1-b2a2-7a98c3e7009f None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.368945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c19b-c4af-4fd1-b2a2-7a98c3e7009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.387157 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-b960c19b-c4af-4fd1-b2a2-7a98c3e7009f None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:24.388336 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b960c19b-c4af-4fd1-b2a2-7a98c3e7009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:24.397018 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1408/2837] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:24.401367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a822c7-3078-4a5c-9756-95c1fa23e5e4 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:24.411710 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a822c7-3078-4a5c-9756-95c1fa23e5e4 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:24.416484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:24.417126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.417404 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.417675 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.418393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:33:24.418736 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:24.420310 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:24.432250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1430/2838] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:33:24.436472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c19b-c4af-4fd1-b2a2-7a98c3e7009f None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:24.445772 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c19b-c4af-4fd1-b2a2-7a98c3e7009f None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:24.450316 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:24.450990 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.451271 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.451542 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.452232 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:24.454143 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:24.542442 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1409/2839] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:24 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:24.546558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:24.557253 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee6397-8588-4d77-889d-6c6c59fade2d admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:24.612682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:24.613354 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.613697 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.613927 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.614641 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:24.616560 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:24.746120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1431/2840] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:24 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:24.750418 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:24.760786 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ed52-9661-4252-b698-7a9465c8ccca admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:24.765991 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:24.766679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.766964 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.767236 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.767962 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:24.769535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:24.785543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1410/2841] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:24.789687 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:24.800107 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb1fb-93b1-4922-b805-9233fe2c212f admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:24.804590 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632c6f1-83e0-47c8-95ca-ba6430718af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:24.805236 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632c6f1-83e0-47c8-95ca-ba6430718af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.805512 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632c6f1-83e0-47c8-95ca-ba6430718af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.805780 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632c6f1-83e0-47c8-95ca-ba6430718af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.806671 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632c6f1-83e0-47c8-95ca-ba6430718af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:24.808250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632c6f1-83e0-47c8-95ca-ba6430718af7 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:24.818398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1432/2842] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:24.822632 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:24.833557 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59285ed5-45f4-4625-9fc9-d9d9dce4d9d1 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:24.838575 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:24.839487 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:24.840012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:24.840283 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] PATH_INFO: `/v3/projects/3e1b7835d89c42baae94fedef38d91bd/users/2203562731c54e1d8e39b7ffc0d3b639/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:24.856685 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1b7835d89c42baae94fedef38d91bd, user_id=2203562731c54e1d8e39b7ffc0d3b639, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:24.860603 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:24.991347 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1411/2843] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:24 2022] PUT /identity/v3/projects/3e1b7835d89c42baae94fedef38d91bd/users/2203562731c54e1d8e39b7ffc0d3b639/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:25.001808 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54db73-3094-4303-a21c-62ee84f1df31 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:25.012964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54db73-3094-4303-a21c-62ee84f1df31 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:25.012964 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54db73-3094-4303-a21c-62ee84f1df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:25.029571 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-fd54db73-3094-4303-a21c-62ee84f1df31 None None] MFA Rules not processed for user `2203562731c54e1d8e39b7ffc0d3b639`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:25.031046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-fd54db73-3094-4303-a21c-62ee84f1df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:25.098073 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1433/2844] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:25.110357 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:25.112089 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:25.174263 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aebbd-72ed-49ed-9977-00609204db1b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:25.177887 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f66c4-d62c-4708-abd7-6ad443243b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:25.178526 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f66c4-d62c-4708-abd7-6ad443243b26 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:25.178872 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f66c4-d62c-4708-abd7-6ad443243b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:25.179148 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f66c4-d62c-4708-abd7-6ad443243b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:25.188098 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f66c4-d62c-4708-abd7-6ad443243b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:25.189512 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f66c4-d62c-4708-abd7-6ad443243b26 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:25.198229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1412/2845] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:25.223933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54db73-3094-4303-a21c-62ee84f1df31 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:25.284803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54db73-3094-4303-a21c-62ee84f1df31 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:25.291555 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:25.292431 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:25.292744 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:25.293023 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] PATH_INFO: `/v3/users/2203562731c54e1d8e39b7ffc0d3b639` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:25.294233 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2203562731c54e1d8e39b7ffc0d3b639)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:25.296203 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:25.594521 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2203562731c54e1d8e39b7ffc0d3b639'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:25.595184 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2203562731c54e1d8e39b7ffc0d3b639'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:25.601948 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2203562731c54e1d8e39b7ffc0d3b639'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:25.727881 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2203562731c54e1d8e39b7ffc0d3b639'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:25.728496 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2203562731c54e1d8e39b7ffc0d3b639'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:25.746003 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1434/2846] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:33:25 2022] DELETE /identity/v3/users/2203562731c54e1d8e39b7ffc0d3b639 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:25.752138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:25.752138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:25.752138 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:25.768762 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:25.769945 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:25.827794 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1413/2847] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:25.874079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:25.875768 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:25.932085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ef8d-61ce-4d07-94fb-d3e2240ee7e2 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:25.935672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6c7e6-ff83-478c-8ca4-584eb9674c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:25.936319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6c7e6-ff83-478c-8ca4-584eb9674c42 service neutron] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:25.936654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6c7e6-ff83-478c-8ca4-584eb9674c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:25.936932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6c7e6-ff83-478c-8ca4-584eb9674c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:25.945917 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6c7e6-ff83-478c-8ca4-584eb9674c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:25.947361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6c7e6-ff83-478c-8ca4-584eb9674c42 service neutron] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:25.956825 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1435/2848] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:33:26.330688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:26.332219 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:26.345304 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8824b-12e3-411f-bddf-5c138afe47f1 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:26.350235 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:26.351200 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.351481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.351752 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] PATH_INFO: `/v3/projects/3e1b7835d89c42baae94fedef38d91bd` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.352956 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1b7835d89c42baae94fedef38d91bd)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:26.354878 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:26.450139 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1b7835d89c42baae94fedef38d91bd', 'request_id': 'req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:26.506812 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1b7835d89c42baae94fedef38d91bd', 'request_id': 'req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:26.512873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1b7835d89c42baae94fedef38d91bd', 'request_id': 'req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:26.525543 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] The token cache is being invalidate because project 3e1b7835d89c42baae94fedef38d91bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:33:26.525829 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:26.526463 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-df78e3fd-0d17-48e4-a51b-b8afef89bc9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:33:26.528054 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1414/2849] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:33:26 2022] DELETE /identity/v3/projects/3e1b7835d89c42baae94fedef38d91bd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:26.533514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361d001-5de8-4952-bffa-ff25bdb8d62c None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.534036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361d001-5de8-4952-bffa-ff25bdb8d62c None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.534036 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361d001-5de8-4952-bffa-ff25bdb8d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.551457 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-7361d001-5de8-4952-bffa-ff25bdb8d62c None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:26.552690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-7361d001-5de8-4952-bffa-ff25bdb8d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:26.612439 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1436/2850] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:26.620438 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b3a7c-2184-4243-b137-9b4568864d0b None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.620756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b3a7c-2184-4243-b137-9b4568864d0b None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.621036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b3a7c-2184-4243-b137-9b4568864d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.641481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-fe3b3a7c-2184-4243-b137-9b4568864d0b None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:26.642757 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-fe3b3a7c-2184-4243-b137-9b4568864d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:26.651022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1415/2851] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:26.655536 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361d001-5de8-4952-bffa-ff25bdb8d62c None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:26.665930 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361d001-5de8-4952-bffa-ff25bdb8d62c None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:26.670517 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:26.671199 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.671502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.672355 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.673091 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:33:26.673400 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:26.675017 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:26.686290 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1437/2852] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 31 18:33:26.691383 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b3a7c-2184-4243-b137-9b4568864d0b None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:26.700672 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b3a7c-2184-4243-b137-9b4568864d0b None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:26.706036 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:26.706718 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.707001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.707275 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.707973 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:26.709915 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:26.782679 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1416/2853] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:33:26 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:26.786909 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:26.797572 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d40bf-d6ad-4c9c-8d97-65595a06ab48 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:26.854240 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:26.854951 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.855235 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.855539 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.856205 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:26.858113 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:26.912823 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1438/2854] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:33:26 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:33:26.917001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:26.927749 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cf1b5-6719-4168-b861-2fb2b3f411ef admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:26.932445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:26.933088 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.933393 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.933667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.934385 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:26.936119 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:26.946870 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1417/2855] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:26.951088 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:26.961862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb63d4-261a-4a6b-9ea3-c65c95bf0d19 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:26.966914 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34037564-c496-4378-895e-d2dbafcd0241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:26.967618 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34037564-c496-4378-895e-d2dbafcd0241 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:26.967938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34037564-c496-4378-895e-d2dbafcd0241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:26.968219 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34037564-c496-4378-895e-d2dbafcd0241 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:26.969015 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34037564-c496-4378-895e-d2dbafcd0241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:26.970788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34037564-c496-4378-895e-d2dbafcd0241 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:26.981250 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1439/2856] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:33:26.986403 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:26.996323 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3c4a2-d009-4772-8a2d-3d6d404592d9 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:27.001755 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:27.002649 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:27.002934 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:27.003210 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] PATH_INFO: `/v3/projects/0f2d961f71194831954c10d99bcd4e64/users/1cba9a710d9f4faeb9a267f284223dc0/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:27.017458 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2d961f71194831954c10d99bcd4e64, user_id=1cba9a710d9f4faeb9a267f284223dc0, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:27.020211 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:27.096022 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1418/2857] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:33:26 2022] PUT /identity/v3/projects/0f2d961f71194831954c10d99bcd4e64/users/1cba9a710d9f4faeb9a267f284223dc0/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:33:27.101085 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916104f-1647-45bb-b20a-fd32c27ad202 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:27.101374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916104f-1647-45bb-b20a-fd32c27ad202 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:27.101653 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916104f-1647-45bb-b20a-fd32c27ad202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:27.120321 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-0916104f-1647-45bb-b20a-fd32c27ad202 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:27.121554 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-0916104f-1647-45bb-b20a-fd32c27ad202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:27.179583 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1440/2858] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:27.190747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:27.192548 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:27.248012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9998f5-9239-48a9-9d14-10dafbafeaf8 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:27.252351 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:27.252993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:27.253277 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:27.253552 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:27.262522 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:27.263972 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:27.273397 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1419/2859] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:28.867110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7648a-b6c6-455f-84e9-2f6ddb1440d7 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:28.867660 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7648a-b6c6-455f-84e9-2f6ddb1440d7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:28.867783 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7648a-b6c6-455f-84e9-2f6ddb1440d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:28.893935 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-72b7648a-b6c6-455f-84e9-2f6ddb1440d7 None None] MFA Rules not processed for user `1cba9a710d9f4faeb9a267f284223dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:28.895188 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-72b7648a-b6c6-455f-84e9-2f6ddb1440d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:28.958915 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1441/2860] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:28.970172 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:28.971667 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:29.027430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b541d-4e18-40c0-bc39-17192871bf6d service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:29.034008 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:29.034703 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:29.034981 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:29.035249 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:29.044144 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:29.045606 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:29.064250 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1420/2861] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:33:30.792925 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd564b-37b4-4f30-addf-eb642403349f None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:30.793563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd564b-37b4-4f30-addf-eb642403349f None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:30.793563 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd564b-37b4-4f30-addf-eb642403349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:30.811034 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-6fbd564b-37b4-4f30-addf-eb642403349f None None] MFA Rules not processed for user `1cba9a710d9f4faeb9a267f284223dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:33:30.812357 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-6fbd564b-37b4-4f30-addf-eb642403349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:30.819569 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1442/2862] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:33:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:33:31.045717 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:33:31.047441 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:31.059484 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72290cdb-74e9-4adf-b540-6b2c6a9902a9 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:33:31.063966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:33:31.064612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:33:31.064894 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:33:31.065169 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:33:31.067003 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:33:31.076722 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:33:31.078902 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:33:31.086728 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1421/2863] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:33:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:34:10.558196 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd564b-37b4-4f30-addf-eb642403349f None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:34:10.567938 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd564b-37b4-4f30-addf-eb642403349f None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:34:10.571487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ace0-5c6b-4848-b106-56bc6874eda6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:34:10.572256 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ace0-5c6b-4848-b106-56bc6874eda6 service cinder] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:34:10.572465 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ace0-5c6b-4848-b106-56bc6874eda6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:34:10.572739 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ace0-5c6b-4848-b106-56bc6874eda6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:34:10.574528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9f65ace0-5c6b-4848-b106-56bc6874eda6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:34:10.643284 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65ace0-5c6b-4848-b106-56bc6874eda6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:34:10.645955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65ace0-5c6b-4848-b106-56bc6874eda6 service cinder] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:34:10.657265 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1443/2864] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:34:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:34:40.277352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:34:40.286708 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa652ab8-0d85-4895-99f6-8d3783db7072 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:34:40.290324 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:34:40.290987 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:34:40.291268 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:34:40.291537 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:34:40.293260 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:34:40.306426 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:34:40.307873 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:34:40.319377 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1422/2865] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:34:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:34:57.268564 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760161d-bfb1-4eb5-8327-ddc5e429580a None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:34:57.269110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760161d-bfb1-4eb5-8327-ddc5e429580a None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:34:57.269110 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760161d-bfb1-4eb5-8327-ddc5e429580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:34:57.286130 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2760161d-bfb1-4eb5-8327-ddc5e429580a None None] MFA Rules not processed for user `1cba9a710d9f4faeb9a267f284223dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:34:57.287899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2760161d-bfb1-4eb5-8327-ddc5e429580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:34:57.295063 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1444/2866] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:34:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:35:00.921320 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:35:00.934300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899daa2-bbd7-4486-a2c4-e96e5b931823 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:35:00.937914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:35:00.938591 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:35:00.938904 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:35:00.939181 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:35:00.941035 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:35:00.951221 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:35:00.953761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:35:00.962740 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1423/2867] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:35:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:36:11.420319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760161d-bfb1-4eb5-8327-ddc5e429580a None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:11.451522 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760161d-bfb1-4eb5-8327-ddc5e429580a None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:11.456181 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:11.457050 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:11.457326 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:11.457598 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] PATH_INFO: `/v3/users/1cba9a710d9f4faeb9a267f284223dc0` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:11.458831 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cba9a710d9f4faeb9a267f284223dc0)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:11.461417 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:11.701683 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cba9a710d9f4faeb9a267f284223dc0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:11.702319 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cba9a710d9f4faeb9a267f284223dc0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:11.710374 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cba9a710d9f4faeb9a267f284223dc0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:11.792942 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cba9a710d9f4faeb9a267f284223dc0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:11.793553 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-46bf2bd9-f1e7-4c7b-a131-5582def303bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cba9a710d9f4faeb9a267f284223dc0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:11.811869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1445/2868] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:36:11 2022] DELETE /identity/v3/users/1cba9a710d9f4faeb9a267f284223dc0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:36:12.104092 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:12.117050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c00487-bf08-4dad-9098-696cc058fa66 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:12.173126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:12.174012 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.174297 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.174576 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] PATH_INFO: `/v3/projects/0f2d961f71194831954c10d99bcd4e64` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.175795 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2d961f71194831954c10d99bcd4e64)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:12.177694 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:12.284580 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2d961f71194831954c10d99bcd4e64', 'request_id': 'req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:12.341975 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2d961f71194831954c10d99bcd4e64', 'request_id': 'req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:12.348503 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2d961f71194831954c10d99bcd4e64', 'request_id': 'req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:12.359891 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] The token cache is being invalidate because project 0f2d961f71194831954c10d99bcd4e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:36:12.360178 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:12.360825 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-7e0dd7c0-2639-43e4-a44c-c5acd1189fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:36:12.362360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1424/2869] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:36:12 2022] DELETE /identity/v3/projects/0f2d961f71194831954c10d99bcd4e64 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:36:12.367331 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fca5e-6930-4c55-b559-27306bcbe4e7 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.367621 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fca5e-6930-4c55-b559-27306bcbe4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.367902 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fca5e-6930-4c55-b559-27306bcbe4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.385955 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-2a0fca5e-6930-4c55-b559-27306bcbe4e7 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:12.387191 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-2a0fca5e-6930-4c55-b559-27306bcbe4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:12.446213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1446/2870] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:36:12.454272 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658093c-d227-44b9-b68c-22a9abe04b82 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.454567 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658093c-d227-44b9-b68c-22a9abe04b82 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.454892 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658093c-d227-44b9-b68c-22a9abe04b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.473616 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-6658093c-d227-44b9-b68c-22a9abe04b82 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:12.474867 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6658093c-d227-44b9-b68c-22a9abe04b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:12.483344 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1425/2871] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:36:12.487544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fca5e-6930-4c55-b559-27306bcbe4e7 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:12.498249 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fca5e-6930-4c55-b559-27306bcbe4e7 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:12.502933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:12.503595 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.503907 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.504187 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.504919 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 31 18:36:12.505229 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:12.507899 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:12.519523 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1447/2872] 10.222.0.58 () {58 vars in 1152 bytes} [Thu Mar 31 18:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 31 18:36:12.524099 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658093c-d227-44b9-b68c-22a9abe04b82 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:12.533668 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658093c-d227-44b9-b68c-22a9abe04b82 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:12.538475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:12.539162 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.539446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.539746 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.540475 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:12.542360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:12.658641 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1426/2873] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:36:12 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 31 18:36:12.663019 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:12.673637 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ceb63-76e2-4783-ae93-8e02a0336be9 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:12.728289 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:12.729273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.729558 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.729833 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.730524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:12.732495 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:12.860911 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1448/2874] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:36:12 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:36:12.864968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:12.875766 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35320aeb-3c1a-4559-871e-ae0cc9644efc admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:12.880330 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:12.880979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.881398 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.881678 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.882396 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:12.884019 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:12.894501 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1427/2875] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:36:12.899090 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:12.909368 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27298a-1f29-409f-a587-c40bd725a641 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:12.916561 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8cbdb-1617-448e-b1b7-c7c9d4edd8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:12.917232 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8cbdb-1617-448e-b1b7-c7c9d4edd8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.917502 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8cbdb-1617-448e-b1b7-c7c9d4edd8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.917785 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8cbdb-1617-448e-b1b7-c7c9d4edd8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.918515 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8cbdb-1617-448e-b1b7-c7c9d4edd8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:12.920264 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8cbdb-1617-448e-b1b7-c7c9d4edd8a2 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:12.931699 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1449/2876] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:36:12.935979 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:12.946968 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61cefb-6b40-4dd5-b033-6fa05cd4c67b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:12.951481 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:12.952360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:12.952645 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:12.952923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] PATH_INFO: `/v3/projects/46be7326d5204beeb8c5e499e9d4ac73/users/80b573d868454d74bdd8c7282718c085/roles/7e3d435fdd2047a4bf96a5fc9661c311` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:12.968433 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46be7326d5204beeb8c5e499e9d4ac73, user_id=80b573d868454d74bdd8c7282718c085, role_id=7e3d435fdd2047a4bf96a5fc9661c311)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:12.971213 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:13.079338 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1428/2877] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:36:12 2022] PUT /identity/v3/projects/46be7326d5204beeb8c5e499e9d4ac73/users/80b573d868454d74bdd8c7282718c085/roles/7e3d435fdd2047a4bf96a5fc9661c311 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:36:13.084712 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb97c4-3a09-40b5-89b5-49477b720b93 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:13.085176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb97c4-3a09-40b5-89b5-49477b720b93 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:13.085460 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb97c4-3a09-40b5-89b5-49477b720b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:13.105524 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-08eb97c4-3a09-40b5-89b5-49477b720b93 None None] MFA Rules not processed for user `214bd24980334d9c9b15c0df533aa535`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:13.106793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-08eb97c4-3a09-40b5-89b5-49477b720b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:13.166391 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1450/2878] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:36:13.176306 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:13.178535 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:13.246446 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a97b-0884-4b67-82b0-d6badb9bfa53 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:13.250141 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:13.250832 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:13.251132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:13.251432 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:13.261716 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:13.263220 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:13.273346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1429/2879] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:36:19.307690 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5245-07e1-4c4a-9037-9023add3bad3 None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:19.308251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5245-07e1-4c4a-9037-9023add3bad3 None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:19.308251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5245-07e1-4c4a-9037-9023add3bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:19.342210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-51bd5245-07e1-4c4a-9037-9023add3bad3 None None] MFA Rules not processed for user `80b573d868454d74bdd8c7282718c085`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:19.343696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-51bd5245-07e1-4c4a-9037-9023add3bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:19.421959 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1451/2880] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:36:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:36:19.426761 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:19.437423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99d9a4-9f7e-4127-8057-03d537e332e0 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:19.442058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:19.442747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:19.443028 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:19.443300 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:19.444993 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:19.446914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:19.584952 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1430/2881] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Mar 31 18:36:19 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:36:19.588853 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5245-07e1-4c4a-9037-9023add3bad3 None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:19.600519 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5245-07e1-4c4a-9037-9023add3bad3 None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:19.656716 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:19.657309 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:19.657592 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:19.657867 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] PATH_INFO: `/v3/users` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:19.658562 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:19.660514 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:19.776732 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1452/2882] 10.222.0.58 () {60 vars in 1143 bytes} [Thu Mar 31 18:36:19 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 31 18:36:19.780838 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:19.792001 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c05887-2969-4515-aead-2ddc89ff73f4 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:19.796982 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:19.797658 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:19.798072 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:19.798360 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:19.799160 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:19.800769 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:19.812782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1431/2883] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 31 18:36:19.817143 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:19.827390 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48f193-2206-4e67-977b-cde06f9e4007 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:19.832273 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:19.833147 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:19.833423 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:19.833691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] PATH_INFO: `/v3/projects/7aead45701fd45b6a6090b73905ef148/users/215ebce921d54cff906211e3075203e0/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:19.848753 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aead45701fd45b6a6090b73905ef148, user_id=215ebce921d54cff906211e3075203e0, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:19.851933 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:19.965989 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1453/2884] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:36:19 2022] PUT /identity/v3/projects/7aead45701fd45b6a6090b73905ef148/users/215ebce921d54cff906211e3075203e0/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:36:19.969814 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:19.981637 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49d2d-69b4-4d19-8243-7ff285acc22b admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:20.046663 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be2f5c-6ab2-4757-ab2a-8f5b7c4b32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:20.047352 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2f5c-6ab2-4757-ab2a-8f5b7c4b32ad admin admin] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:20.047636 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2f5c-6ab2-4757-ab2a-8f5b7c4b32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:20.047914 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2f5c-6ab2-4757-ab2a-8f5b7c4b32ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:20.048659 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be2f5c-6ab2-4757-ab2a-8f5b7c4b32ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:20.050293 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be2f5c-6ab2-4757-ab2a-8f5b7c4b32ad admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:20.062065 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1432/2885] 10.222.0.58 () {58 vars in 1121 bytes} [Thu Mar 31 18:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 31 18:36:20.065803 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:20.076389 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6b2c6-f1b7-4b32-a919-d7a170859e76 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:20.081001 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:20.081878 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] REQUEST_METHOD: `PUT` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:20.082160 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:20.082433 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] PATH_INFO: `/v3/projects/7aead45701fd45b6a6090b73905ef148/users/215ebce921d54cff906211e3075203e0/roles/641f3a975368436eac3de51f3605c569` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:20.085176 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aead45701fd45b6a6090b73905ef148, user_id=215ebce921d54cff906211e3075203e0, role_id=641f3a975368436eac3de51f3605c569)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:20.088080 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:20.099209 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1454/2886] 10.222.0.58 () {60 vars in 1482 bytes} [Thu Mar 31 18:36:20 2022] PUT /identity/v3/projects/7aead45701fd45b6a6090b73905ef148/users/215ebce921d54cff906211e3075203e0/roles/641f3a975368436eac3de51f3605c569 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:36:26.087412 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334776ad-48b0-4a73-8588-755b4bee7d7d None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:26.088044 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334776ad-48b0-4a73-8588-755b4bee7d7d None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:26.088158 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334776ad-48b0-4a73-8588-755b4bee7d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:26.117835 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-334776ad-48b0-4a73-8588-755b4bee7d7d None None] MFA Rules not processed for user `215ebce921d54cff906211e3075203e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:26.119102 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-334776ad-48b0-4a73-8588-755b4bee7d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:26.189359 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1433/2887] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:36:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:36:26.201277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:26.209674 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:26.305068 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc96070-8d5d-4159-8d35-165d5d21f972 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:26.308928 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bfec7fb739b42bfa2ddd682aa10dc95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:26.309577 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:26.309852 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:26.310122 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:26.371862 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:26.373314 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:26.383630 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1455/2888] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:36:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:36:26.741477 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38eef2c-04cd-495c-b506-e933db3ef3fe None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:26.741768 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38eef2c-04cd-495c-b506-e933db3ef3fe None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:26.742050 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38eef2c-04cd-495c-b506-e933db3ef3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:26.805199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-f38eef2c-04cd-495c-b506-e933db3ef3fe None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:26.805199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-f38eef2c-04cd-495c-b506-e933db3ef3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:26.869087 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1434/2889] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:36:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:36:27.048544 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:27.049945 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:27.157213 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd741a9-3115-42cc-8a7b-eb52e810f503 service glance] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:27.165158 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:27.165837 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:27.166131 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:27.167082 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:27.177278 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:27.181064 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:27.190549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1456/2890] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:36:38.206651 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c664b46-5a5a-4f4e-a7e6-1aa1ca71d4a6 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:38.207195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c664b46-5a5a-4f4e-a7e6-1aa1ca71d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:38.207195 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c664b46-5a5a-4f4e-a7e6-1aa1ca71d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:38.225713 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-5c664b46-5a5a-4f4e-a7e6-1aa1ca71d4a6 None None] MFA Rules not processed for user `80b573d868454d74bdd8c7282718c085`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:38.226954 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-5c664b46-5a5a-4f4e-a7e6-1aa1ca71d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:38.233765 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1435/2891] 10.222.0.58 () {58 vars in 957 bytes} [Thu Mar 31 18:36:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 31 18:36:38.892849 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:38.894356 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:38.965315 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f367-7002-4405-8c1b-d63eea3c2fd5 service swift] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:38.970403 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:38.971070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:38.971347 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:38.971623 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:38.973376 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:38.985696 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:38.987306 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:38.998266 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1457/2892] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:36:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:36:42.065125 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] REQUEST_METHOD: `POST` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:42.065559 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:42.065686 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:42.091783 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.auth.core [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:36:42.093005 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:42.102229 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1436/2893] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Mar 31 18:36:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:36:42.116370 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:42.128654 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fde2-6bd6-41d5-a395-8a7956247888 service placement] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:42.135412 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:42.136075 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:42.136361 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:42.136640 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:42.148007 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:42.149883 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:42.159793 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1458/2894] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:36:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:36:43.312400 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:36:43.314756 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:43.423753 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6829b-b5be-418a-8fe0-22c749899715 None None] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:36:43.436445 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:36:43.437630 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:36:43.437927 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:36:43.438362 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:36:43.442173 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:36:43.461016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:36:43.463046 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:36:43.477907 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1437/2895] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:36:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:37:01.662834 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:37:01.664328 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:37:01.708070 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509fd5c-8f50-407a-ac6c-0fcbda00f8c9 service swift] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:37:01.716771 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:37:01.720672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:37:01.720672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:37:01.720672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:37:01.720672 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:37:01.733440 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:37:01.735049 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:37:01.745967 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1459/2896] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:37:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:37:17.093014 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:37:17.167824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce76227-c5fc-4ac1-8111-c9136bd18b9a service nova] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:37:17.171532 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:37:17.172188 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:37:17.172469 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:37:17.172748 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:37:17.183156 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:37:17.184612 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:37:17.194782 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1438/2897] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:37:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:37:51.891490 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:37:51.892920 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:37:51.932021 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28581989-bcd8-4c9f-af6b-02c4ddad0685 service nova] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:37:51.939752 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:37:51.940408 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:37:51.940691 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:37:51.940968 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:37:51.942802 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:37:51.954972 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:37:51.956695 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:37:51.967934 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1460/2898] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:37:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:39:36.342568 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:36.343996 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:36.369233 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072f6d-fb61-4d94-afef-ea5c0e0e818e service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:36.372824 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7436a3068f6545a4b74c877c5b8c81c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:36.373470 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:36.373747 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:36.374016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:36.375793 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:36.414751 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:36.416194 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:36.437811 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1439/2899] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:39:37.011860 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:37.026686 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754c7c2-91ad-4ba3-9754-9ad0ea76e7ee service placement] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:37.035418 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b8053-e139-4953-a9ce-558127d01f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e46af6e41bb45c08e5a6b9fd596e4f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:37.036174 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8053-e139-4953-a9ce-558127d01f18 service nova] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:37.036528 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8053-e139-4953-a9ce-558127d01f18 service nova] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:37.036875 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b8053-e139-4953-a9ce-558127d01f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:37.039658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-110b8053-e139-4953-a9ce-558127d01f18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:37.061312 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b8053-e139-4953-a9ce-558127d01f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:37.062888 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b8053-e139-4953-a9ce-558127d01f18 service nova] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:37.079932 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1461/2900] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:39:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 31 18:39:41.037254 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:41.038674 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:41.115319 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450696-4b06-4d7b-86e8-61b55e3d43e5 service neutron] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:41.118997 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95559d1e48934be89e562208ff65d195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:41.119642 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:41.119923 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:41.120199 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:41.121939 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:41.135818 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:41.137240 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:41.149058 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1440/2901] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:39:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 31 18:39:47.695946 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5002-48d0-4e4f-bfae-69b7681e914b None None] REQUEST_METHOD: `POST` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:47.696398 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5002-48d0-4e4f-bfae-69b7681e914b None None] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:47.696533 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5002-48d0-4e4f-bfae-69b7681e914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:47.716279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.auth.core [None req-01ba5002-48d0-4e4f-bfae-69b7681e914b None None] MFA Rules not processed for user `e485723f69be454a99c9a41adf4b5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 31 18:39:47.717454 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-01ba5002-48d0-4e4f-bfae-69b7681e914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:47.724692 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1462/2902] 10.222.0.58 () {58 vars in 967 bytes} [Thu Mar 31 18:39:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 31 18:39:47.764660 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:47.776242 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c138-b551-4421-8f92-62f133028f41 service cinder] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:47.781453 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b2e34e638041f7a5338c0d8ae1fa25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:47.782202 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] REQUEST_METHOD: `GET` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:47.782665 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:47.782949 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:47.790874 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:47.792431 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:47.801126 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1441/2903] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Mar 31 18:39:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 31 18:39:56.588491 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba5002-48d0-4e4f-bfae-69b7681e914b None None] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:56.670279 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba5002-48d0-4e4f-bfae-69b7681e914b None None] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:56.676411 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:56.677267 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:56.677549 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:56.677869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] PATH_INFO: `/v3/users/80b573d868454d74bdd8c7282718c085` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:56.679097 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b573d868454d74bdd8c7282718c085)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:56.680990 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:56.883501 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b573d868454d74bdd8c7282718c085'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:56.884120 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b573d868454d74bdd8c7282718c085'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:56.890682 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b573d868454d74bdd8c7282718c085'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:56.973788 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b573d868454d74bdd8c7282718c085'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:56.974393 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b573d868454d74bdd8c7282718c085'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:56.992100 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1463/2904] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:39:56 2022] DELETE /identity/v3/users/80b573d868454d74bdd8c7282718c085 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:39:57.278966 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:57.291947 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c062-aac0-47d2-a535-1627d0e57f56 service swift] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:57.349165 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:57.351472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:57.351472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:57.351472 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] PATH_INFO: `/v3/projects/46be7326d5204beeb8c5e499e9d4ac73` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:57.351876 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46be7326d5204beeb8c5e499e9d4ac73)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:57.353849 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:57.456715 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46be7326d5204beeb8c5e499e9d4ac73', 'request_id': 'req-61736365-1f42-4c39-a51d-c0c37605ce82'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.533132 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46be7326d5204beeb8c5e499e9d4ac73', 'request_id': 'req-61736365-1f42-4c39-a51d-c0c37605ce82'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.537382 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46be7326d5204beeb8c5e499e9d4ac73', 'request_id': 'req-61736365-1f42-4c39-a51d-c0c37605ce82'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.564318 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] The token cache is being invalidate because project 46be7326d5204beeb8c5e499e9d4ac73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:39:57.564634 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.565422 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.567077 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1442/2905] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:39:57 2022] DELETE /identity/v3/projects/46be7326d5204beeb8c5e499e9d4ac73 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 31 18:39:57.571079 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:57.572534 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:57.585251 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c75c8-a86b-436c-9ba9-9067dd4e4029 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:57.643789 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:57.644658 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:57.644937 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:57.645210 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] PATH_INFO: `/v3/users/215ebce921d54cff906211e3075203e0` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:57.646379 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215ebce921d54cff906211e3075203e0)` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:57.648313 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:57.821367 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215ebce921d54cff906211e3075203e0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.822046 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215ebce921d54cff906211e3075203e0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.830484 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215ebce921d54cff906211e3075203e0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.934126 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215ebce921d54cff906211e3075203e0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.934869 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.notifications [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215ebce921d54cff906211e3075203e0'} {{(pid=79918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:57.953114 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1464/2906] 10.222.0.58 () {58 vars in 1223 bytes} [Thu Mar 31 18:39:57 2022] DELETE /identity/v3/users/215ebce921d54cff906211e3075203e0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:39:58.221405 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Authenticating user token {{(pid=79917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:39:58.222933 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.fernet_utils [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:39:58.237739 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61736365-1f42-4c39-a51d-c0c37605ce82 admin admin] Validating token access rules against request {{(pid=79917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:39:58.297016 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214bd24980334d9c9b15c0df533aa535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '742ba5e3bf724a7681af774ed2a8d3b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:39:58.298152 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:39:58.298430 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:39:58.298732 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] PATH_INFO: `/v3/projects/7aead45701fd45b6a6090b73905ef148` {{(pid=79917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:39:58.299911 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aead45701fd45b6a6090b73905ef148)` {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:39:58.301796 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] RBAC: Authorization granted {{(pid=79917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:39:58.465346 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aead45701fd45b6a6090b73905ef148', 'request_id': 'req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:58.545015 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aead45701fd45b6a6090b73905ef148', 'request_id': 'req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:58.551423 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aead45701fd45b6a6090b73905ef148', 'request_id': 'req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c'} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:58.562364 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] The token cache is being invalidate because project 7aead45701fd45b6a6090b73905ef148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 31 18:39:58.562688 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:58.563848 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: DEBUG keystone.notifications [None req-3a12b31f-d7ae-4da5-89bd-711eec3a0d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 31 18:39:58.565777 dv-cinder-master-3-iscsi devstack@keystone.service[79917]: [pid: 79917|app: 0|req: 1443/2907] 10.222.0.58 () {58 vars in 1232 bytes} [Thu Mar 31 18:39:58 2022] DELETE /identity/v3/projects/7aead45701fd45b6a6090b73905ef148 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 31 18:42:56.931084 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Authenticating user token {{(pid=79918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 31 18:42:56.932487 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:42:56.999884 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c88b32-4b18-44db-8b71-625c28688160 admin admin] Validating token access rules against request {{(pid=79918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 31 18:42:57.059316 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34b6bc-3db1-407a-b232-ddcfbc9ddd1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511e982844c347c8bd49f51aaf29be71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d88303898234f6ea96c154537ff7558', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 31 18:42:57.059993 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b6bc-3db1-407a-b232-ddcfbc9ddd1a service placement] REQUEST_METHOD: `GET` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 31 18:42:57.060277 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b6bc-3db1-407a-b232-ddcfbc9ddd1a service placement] SCRIPT_NAME: `/identity` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 31 18:42:57.060556 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b6bc-3db1-407a-b232-ddcfbc9ddd1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 31 18:42:57.062340 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.fernet_utils [None req-ca34b6bc-3db1-407a-b232-ddcfbc9ddd1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 31 18:42:57.074466 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34b6bc-3db1-407a-b232-ddcfbc9ddd1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 31 18:42:57.076065 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34b6bc-3db1-407a-b232-ddcfbc9ddd1a service placement] RBAC: Authorization granted {{(pid=79918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 31 18:42:57.086953 dv-cinder-master-3-iscsi devstack@keystone.service[79918]: [pid: 79918|app: 0|req: 1465/2908] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Mar 31 18:42:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)